Commit Graph

147 Commits

Author SHA1 Message Date
phikoehn
ac7670c5e7 minor bugs with factors 2014-06-06 14:14:35 +01:00
phikoehn
ceadacd3af Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-05 21:33:35 +01:00
Philipp Koehn
15288213be allow < > in factors 2014-06-05 21:31:09 +01:00
Ulrich Germann
9c27dc08e9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses/FF/ConstrainedDecoding.cpp
2014-06-03 18:55:53 +01:00
Ulrich Germann
0b6a0e42d6 scripts/generic/bsbleu.py: Bug fix. 2014-05-30 13:51:22 +01:00
Ulrich Germann
d3b058ca4b scripts/generic/bsbleu.py: Confidence interval can now be set via command line argument. 2014-05-30 13:50:10 +01:00
Ulrich Germann
67be805211 Added scripts/generic/bsbleu.py: bleu score computation with confidence intervals via boostrap resampling. 2014-05-30 13:12:07 +01:00
Hieu Hoang
42a1989f86 generic parallization that take stdin and output to stdout. For parsing 2014-05-23 01:03:29 +01:00
Hieu Hoang
403a473222 utf8 encoding 2014-05-22 21:23:31 +01:00
Hieu Hoang
3df23ea6ad utf8 encoding 2014-05-22 19:00:36 +01:00
Hieu Hoang
7ec0c53e92 generic parallization that take stdin and output to stdout. For parsing 2014-05-22 15:22:55 +01:00
Hieu Hoang
d97be10a27 generic parallization that take stdin and output to stdout. For parsing 2014-05-22 14:38:27 +01:00
Hieu Hoang
b6d47733da remove duplicate spaces caused when XML are stripped 2014-01-24 18:09:55 +00:00
Hieu Hoang
19aa8c1056 changes to moses-parallel.pl to make it work. /Thomas Meyer 2013-12-05 12:23:40 +00:00
Rico Sennrich
7138056b8f flexibility scores 2013-09-07 23:04:01 +02:00
Hieu Hoang
ac50d9f349 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-08-01 16:55:46 +01:00
Hieu Hoang
f234aa203f number recognizer treats each word as atomic, replace all of the word or nothing at all. Recognizer is designed to be run after the text has been tokenized, not before 2013-08-01 16:55:11 +01:00
Hieu Hoang
4bc7ce99ed add script to strip xml 2013-07-29 11:27:13 +01:00
Hieu Hoang
a3e3289b08 In corpus mode, replace number with number symbol 2013-07-25 15:54:47 +01:00
Hieu Hoang
78381d0213 @NUM@ --> @num@. In case using recaser 2013-07-25 15:16:15 +01:00
Hieu Hoang
6fc21a32fc Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-24 19:01:57 +01:00
Hieu Hoang
c104dee3b2 merge glue grammars, rather than writing them all to the same file. Required by Phil Williams & others when doing syntax extraction 2013-07-24 19:01:46 +01:00
Achim Ruopp
1813f9784b Additional factoring to allow more NE recognizers; bug fixes 2013-07-24 12:44:53 -04:00
unknown
54eb50523b Converted into modulino; added support for French numbers 2013-07-19 14:41:01 -04:00
Hieu Hoang
4e4cf1e313 script to replace numbers with placeholder. /Achim Ruopp 2013-07-01 23:00:59 +01:00
Wilker Aziz
f3cd72537c Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-06-24 15:39:18 +01:00
Wilker Aziz
b49e6a162f Wrapper to lmplz 2013-06-24 12:20:20 +01:00
Hieu Hoang
a85f819a53 superceded 2013-06-24 11:33:11 +01:00
Ondrej Bojar
93433cf015 support --translation-details OUTFILE in moses-parallel 2013-04-03 18:10:44 +02:00
Hieu Hoang
1b83b85f44 debug info from sort command 2013-03-18 16:48:40 +00:00
phikoehn
3a7f4f776a minor 2013-03-13 17:54:29 +00:00
phikoehn
d5cf38cab2 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2013-01-14 19:23:02 +00:00
phikoehn
344b150372 bug fixes with escaping / truecasing interactions 2013-01-14 19:22:29 +00:00
Barry Haddow
459acf87b1 Add support for instance weights file 2013-01-04 14:55:24 +00:00
phikoehn
b275c94dbf allow for inclusion of extract from previous run 2012-12-12 07:02:59 +00:00
Hieu Hoang
487822ed14 don't write to stdout 2012-11-22 15:08:00 +00:00
phikoehn
5cd614ecd8 adjust to irstlm changes 2012-11-20 17:18:57 +00:00
Hieu Hoang
f3ec76ac56 minor change to calling irst training 2012-10-14 19:51:46 +01:00
phikoehn
04544f8bfc better error message when reference file not found 2012-10-04 23:22:19 +01:00
Lane Schwartz
7b042edc6c Send stderr to /dev/null when looking for pawd.
This cleans up the logs a bit for those of us who don't have pawd.
Otherwise, messages like the following show up in the logs:

/usr/bin/which: no pawd in ...
2012-09-28 14:55:09 -04:00
Lane Schwartz
a323c8daf7 Send stderr to /dev/null when looking for pawd.
This cleans up the logs a bit for those of us who don't have pawd.
Otherwise, messages like the following show up in the logs:

/usr/bin/which: no pawd in ...

bash: pawd: command not found
2012-09-28 14:37:53 -04:00
phikoehn
a84fbcb80a bug fix for using domain feature in multi-process extract 2012-09-24 11:14:36 +01:00
Hieu Hoang
30e5b0575b merge conflict 2012-09-03 19:12:00 +01:00
phikoehn
4a1a995878 a lot of changes 2012-08-18 23:48:26 +01:00
phikoehn
366ab93f8a a lot of changes 2012-08-18 23:47:05 +01:00
Hieu Hoang
a8117c0afd redirect more to stderr. Split input extract files every 50m lines, instead of 10m lines 2012-08-08 14:15:31 +01:00
Hieu Hoang
efdb983e0c redirect parallel scoring to standard err, appending to existing 2012-08-07 15:38:42 +01:00
Hieu Hoang
a1ab8e354a cleanup of variables. Need to delete temporary files 2012-07-31 02:21:48 +01:00
Hieu Hoang
23bbf12752 redirect stderr from extract program to stderr of script that runs it, for easier debugging 2012-07-18 22:53:47 +01:00
Hieu Hoang
f0a3e67717 redirect stderr from extract program to stderr of script that runs it, for easier debugging. Recursive create of output directory, in case output directory doesn't exist 2012-07-18 22:33:49 +01:00