moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
14,238 Commits 136 Branches 26 Tags 147 MiB
b4b30cff7a
Commit Graph

14238 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Philipp Koehn
b4b30cff7a fix some compile time warnings about unsigned / signed int 2015-07-20 11:45:23 -04:00
Philipp Koehn
496f8c6d85 only extract reordering phrase pairs if use mmsapt phrase table 2015-07-20 11:44:22 -04:00
Philipp Koehn
fcf2934a2f customized phrase table pruning step 2015-07-20 11:43:02 -04:00
Philipp Koehn
6d0f482361 extended phrase lookup: print sentences, document id 2015-07-20 11:41:48 -04:00
Philipp Koehn
ec3413f7b5 allow customized prefix/suffix to mark unknown words 2015-07-20 11:40:53 -04:00
Rico Sennrich
7b19d83d43 xml support for combine-factors.pl 2015-07-20 10:45:18 +01:00
Rico Sennrich
1b1bafb1e8 ems: add option to factorize after truecase/split/etc. 2015-07-20 10:43:23 +01:00
Rico Sennrich
bec950cf72 support factors in InternalTree 2015-07-20 10:39:01 +01:00
Rico Sennrich
e85f353898 code simplification by removing language-specific, unused hack. 2015-07-20 10:39:01 +01:00
Phil Williams
c1142741a1 relax-parse: write node attributes to output 2015-07-17 14:11:56 +01:00
Jeroen Vermeulen
a64468a991 Document WordsBitmap performance considerations. 2015-07-17 19:23:47 +07:00
Jeroen Vermeulen
342598af0c Cosmetic. 2015-07-17 19:17:38 +07:00
MosesAdmin
1ffcd17ce5 daily automatic beautifier 2015-07-17 00:00:42 +01:00
Hieu Hoang
93409db5a9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-07-16 19:55:52 +01:00
Hieu Hoang
b3baade7f0 changes to make static build work, and limit the number of concurrent connections to moses server. /Pidong Wang 2015-07-16 19:55:16 +01:00
Phil Williams
c83628a92b Fix errors from multiline `` commands in transliteration Perl scripts 
Replace the backslash-newline sequence with backslash-backslash-newline in
multiline backquote command strings.  i.e. replace expressions like this:

  `some-command \
    -option1 \
    -option2`;

with ones like this

  `some-command \\
    -option1 \\
    -option2`;

If I understand this right, the shell converts a backslash-newline sequence
to an empty string (i.e. it discards it), but Perl does not.  Unless the
backslash itself is escaped, using a backslash-newline in a Perl command
string results in errors in most instances.  By escaping the backslash, it
gets passed through to the shell where it is interpreted as intended.
 2015-07-16 14:54:00 +01:00
Jeroen Vermeulen
43300459b3 Replace WordsBitmap malloc() with std::vector. 
It'd be great to use the specialized vector<bool>, or Boost's dynamic_bitset,
for this.  But gcc and clang don't have an optimized find() for vector<bool>,
making it slower rather than faster.  And dynamic_bitset doesn't have reverse
searches or searches for false.
 2015-07-16 17:56:20 +07:00
Jeroen Vermeulen
d4508e984f Compare nullness in Hypothesis::RecombineCompare. 
The comparison code subtracted two pointers in the case where at least one
was null, to get a signed int comparison result.  But that subtraction is
undefined, and the cast to int (dropping the most-significant bits!) made the
outcome even less uncertain.

In this patch I compare the nullness of the pointers instead, which should
always return a well-defined -1, 0, or 1.
 2015-07-16 16:48:20 +07:00
Jeroen Vermeulen
0ca2bcb28d End line after printing progress dots to stderr. 2015-07-16 15:51:16 +07:00
Philipp Koehn
66ecf98cf7 minor bug fix 2015-07-14 11:01:22 -04:00
Rico Sennrich
ca72105fdf fix ems regression 2015-07-14 13:16:25 +01:00
Philipp Koehn
7e3050f7f2 allow saving of model from fast-align (for incremental use) 2015-07-14 05:27:03 -04:00
MosesAdmin
b13b9a36be daily automatic beautifier 2015-07-14 00:00:43 +01:00
Ulrich Germann
f7938f433d Merge branch 'mmt-dev' of http://github.com/modernMT/mosesdecoder 
Conflicts:
	moses/BaseManager.cpp
	moses/StaticData.cpp
	moses/TargetPhrase.cpp
	moses/TargetPhrase.h
 2015-07-13 14:42:59 +01:00
Ulrich Germann
da117e7d3e Bug fix related to m_ttask_flag in TargetPhrase. Also changed m_ttask to weak pointer in TargetPhrase. 2015-07-13 14:25:17 +01:00
Barry Haddow
3fdbb00904 Improvements to handling of bilingual LM in EMS 2015-07-10 15:44:24 +01:00
XapaJIaMnu
36bab92fcf Test and fix errors in the profiling part of speedtest and update documentation. Works. 2015-07-07 11:14:50 +01:00
Phil Williams
e7228ec9fb extract-ghkm: minor refactoring 2015-07-06 14:41:34 +01:00
XapaJIaMnu
540f9e9974 Update documentation for google-profiler. Untested 2015-07-06 14:19:59 +01:00
Phil Williams
44372d7787 extract-ghkm: fix a couple of exception-related issues 2015-07-06 12:05:41 +01:00
MosesAdmin
0fe0f78e92 daily automatic beautifier 2015-07-04 00:00:44 +01:00
XapaJIaMnu
078c8f7fdb Some fixes in the profiler config and added possibility to use google-profiler. Untested still, no documentaion 2015-07-03 17:51:00 +01:00
Ulrich Germann
ba912b66b0 Merge branch 'master' of http://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/StaticData.cpp
 2015-07-03 00:29:48 +01:00
MosesAdmin
b67a8a4fcb daily automatic beautifier 2015-07-03 00:00:41 +01:00
Ulrich Germann
b05ca8cb80 Fixes to make code compile on various versions of gcc. 2015-07-02 18:06:55 +01:00
XapaJIaMnu
070e0a83e1 LD_PRELOAD systax was wrong 2015-07-02 16:57:17 +01:00
Barry Haddow
01e6b3f0b3 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-07-02 09:31:21 +00:00
Ulrich Germann
e94921dc44 Removal of 'using namespace ...' from several header files. 2015-07-02 01:32:34 +01:00
Ulrich Germann
515862ee1c Reformatting for readability. 2015-07-02 01:31:11 +01:00
MosesAdmin
86292f2ce3 daily automatic beautifier 2015-07-02 00:01:16 +01:00
Ulrich Germann
106668d754 Changed m_ttask from ttasksptr to ttaskwptr in TargetPhrase ... 
.. to avoid blocking destruction of TranslationTask at the end of its lifetime.
 2015-07-01 14:48:25 +01:00
Ulrich Germann
851a801c64 Bug fix in copy constructor of TargetPhrase: m_ttask_flag wasn't copied but always set to true. 2015-07-01 14:01:57 +01:00
Ulrich Germann
61067b4fa5 Merge branch 'FF_ttptr' of http://github.com/moses-smt/mosesdecoder 2015-07-01 13:25:26 +01:00
hieu
81f337bcd8 rollback c++11 for now 2015-07-01 09:42:07 +04:00
MosesAdmin
a374706bd4 daily automatic beautifier 2015-07-01 00:00:59 +01:00
Ulrich Germann
5fd19e576a Merge branch 'master' of http://github.com/moses-smt/mosesdecoder 2015-06-30 12:39:25 +01:00
Nicola Bertoldi
6aa6131b84 introduced flag for the existence of TtaskSptr in TargetPhrase 2015-06-29 09:30:26 +02:00
Jeroen Vermeulen
5e81e4b9c3 Simplify unnecessarily complicated condition. 2015-06-29 12:23:53 +07:00
MosesAdmin
fba4a3e24d daily automatic beautifier 2015-06-29 00:00:54 +01:00
Hieu Hoang
f7c3d00824 more testing of c++11 waters 2015-06-28 22:20:42 +04:00