Commit Graph

14173 Commits

Author SHA1 Message Date
Phil Williams
842fc9780e senna2brackets.py: bug fixes + clean-up 2015-05-27 20:33:43 +01:00
Phil Williams
c086a8ee50 Add a wrapper script for parsing English text with SENNA 2015-05-26 16:44:13 +01:00
Jeroen Vermeulen
ea9b097aba OutputFileStream: accept ‘-’ for “stdout”.
This is a common convention: when a program gets a dash as the path of a
file that it should write, it writes to standard output instead.

Enhances portability to systems that don't have /dev/stdout.
2015-05-26 15:06:04 +07:00
Rico Sennrich
f6f56d11af ems: parse-relax comes last in train; do same for dev/test 2015-05-25 15:52:07 +01:00
Hieu Hoang
a693c83161 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-24 20:05:24 +04:00
Hieu Hoang
582a845524 don't use zcat 2015-05-24 20:04:01 +04:00
Ulrich Germann
c82ee9a4e9 Bug fix. 2015-05-24 16:44:41 +01:00
Ulrich Germann
e49ffb8efa Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-24 16:12:13 +01:00
Ulrich Germann
da052b7f2b Removed dependency on libcurlpp, as it was difficult to link that staticly. 2015-05-24 16:05:14 +01:00
Hieu Hoang
df5aff2d82 eclipse 2015-05-24 15:12:05 +01:00
Hieu Hoang
ed8cf103f8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-24 17:34:52 +04:00
Hieu Hoang
502e72ce91 eclipse 2015-05-24 17:08:57 +04:00
Ulrich Germann
3a0cd0518d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-22 15:30:20 +00:00
Rico Sennrich
43527c82fc training script for monolingual Neural LM
(+bugfixes and usability improvements for RDLM training)
2015-05-22 15:31:08 +01:00
Rico Sennrich
a1678187fe wrapper for stanford dependency parser 2015-05-22 15:28:42 +01:00
Jeroen Vermeulen
30a03237fa List extraneous parts of the source tree. 2015-05-22 13:31:38 +07:00
Ulrich Germann
98c976bb1d Bug fix. 2015-05-21 22:17:43 +01:00
Ulrich Germann
33eee96f35 Bug fix related to context-sensitive decoding: --context-string had no effect, even when --context-window was not specified. 2015-05-21 16:36:51 +00:00
Ulrich Germann
812cbb0c8e Added missing #include in OxLM.cpp. 2015-05-21 17:28:09 +01:00
Hieu Hoang
097afb93df eclipse 2015-05-21 14:04:42 +04:00
Ulrich Germann
5807ca4714 Mert programs won't link with shared linking without -lboost_filesystem. 2015-05-21 02:56:03 +00:00
Ulrich Germann
1414834c96 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-21 00:02:59 +01:00
Ulrich Germann
044bfd0b1a util/probing_hash_table_benchmark_main.cc wouldn't compile with boost v.1.46.1. 2015-05-20 23:46:01 +01:00
Hieu Hoang
d8406e3f51 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-20 23:36:22 +04:00
Hieu Hoang
75698c9f1f Use all cores by default /Ken 2015-05-20 23:21:17 +04:00
Ulrich Germann
80ee9813c6 Added missing header for std::cerr. 2015-05-20 17:36:48 +01:00
Rico Sennrich
98ff2382d0 duplication of existing functionality 2015-05-20 17:35:38 +01:00
Rico Sennrich
6aac7ded9a EMS: more flexible way to concatenate LM training data.
the implementation allows the user to specify which corpora to combine,
and to have multiple LMs on the same data.
2015-05-20 17:20:02 +01:00
Kenneth Heafield
1dfbbde846 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-20 10:09:12 -04:00
Kenneth Heafield
a281cc7db2 Revert "Use all cores by default"
This reverts commit 6b1c743711.
2015-05-20 10:08:48 -04:00
Hieu Hoang
36caf2eb9a escape ^# character otherwise morfessors skips line 2015-05-20 15:28:28 +04:00
Jeroen Vermeulen
1c250dac92 Fix _fpclass build failure on MinGW.
On MinGW, use the Unix-style fpclassify() code rather than the Window
version.  The latter doesn't seem to compile.
2015-05-20 15:12:43 +07:00
Jeroen Vermeulen
a66056cd39 Replace M_LN10 altogether. Not entirely standard. 2015-05-20 14:37:00 +07:00
Jeroen Vermeulen
8bbbc0670d Add missing include: <cmath> for M_LN10. 2015-05-20 13:01:14 +07:00
Jeroen Vermeulen
d7f6428875 Add mert/hgdecode binary to .gitignore. 2015-05-20 11:42:29 +07:00
Jeroen Vermeulen
ef5a17b2f9 Fix some new compile problems.
* file_piece.cc used isnan() instead of std::isnan().
 * Fdstream.h used close() but Windows doesn't have unistd.h.

Fixed Fdstream.h by using util::scoped_fd.  Thanks Ken.
2015-05-20 11:40:11 +07:00
Kenneth Heafield
a70d37e46f KenLM 7408730be415db9b650560a8b2bd3e4e3af49ec9.
unistd.hh is dead.
2015-05-19 15:27:30 -04:00
Hieu Hoang
90309aebfa Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-19 22:19:19 +04:00
Hieu Hoang
79ca96db0a should have tested this 2015-05-19 22:19:11 +04:00
Kenneth Heafield
6b1c743711 Use all cores by default 2015-05-19 13:53:20 -04:00
Barry Haddow
eefdf3d6ed Merge branch 'master' of github.com:moses-smt/mosesdecoder 2015-05-19 15:27:58 +00:00
Barry Haddow
f449a8a0a5 Test for WordsBitmap, remove unused code, avoid copy. 2015-05-19 15:24:37 +00:00
Ulrich Germann
152da97136 Added mert/hgdecode to .gitignore (it's a compiled binary). 2015-05-19 16:14:07 +01:00
Hieu Hoang
59071bf16c run on all cores if number of cores not given 2015-05-19 18:32:31 +04:00
Ulrich Germann
2d2be5c9cd Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-05-19 02:36:29 +01:00
Ulrich Germann
dcb8e5d3e0 Preparation for allowing context-aware decoding. 2015-05-19 02:35:39 +01:00
Rico Sennrich
8ca6764c7d ems: allow LMs with user-specified training commands and moses.ini config entries
intended for neural LMs, syntactic LMs, and the like. currently doesn't play nice with INTERPOLATED-LM.
2015-05-18 19:07:37 +01:00
Rico Sennrich
fb06a2325e fix broken ems with interpolated lm disabled 2015-05-18 17:26:09 +01:00
Rico Sennrich
f85dd85f6b ignore-unless magic 2015-05-18 16:17:33 +01:00
Rico Sennrich
59376f500b still confused about pass-unless vs. ignore-unless 2015-05-18 14:40:56 +01:00