phikoehn
ac7670c5e7
minor bugs with factors
2014-06-06 14:14:35 +01:00
phikoehn
ceadacd3af
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-05 21:33:35 +01:00
Philipp Koehn
15288213be
allow < > in factors
2014-06-05 21:31:09 +01:00
Ulrich Germann
9c27dc08e9
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/FF/ConstrainedDecoding.cpp
2014-06-03 18:55:53 +01:00
Ulrich Germann
0b6a0e42d6
scripts/generic/bsbleu.py: Bug fix.
2014-05-30 13:51:22 +01:00
Ulrich Germann
d3b058ca4b
scripts/generic/bsbleu.py: Confidence interval can now be set via command line argument.
2014-05-30 13:50:10 +01:00
Ulrich Germann
67be805211
Added scripts/generic/bsbleu.py: bleu score computation with confidence intervals via boostrap resampling.
2014-05-30 13:12:07 +01:00
Hieu Hoang
42a1989f86
generic parallization that take stdin and output to stdout. For parsing
2014-05-23 01:03:29 +01:00
Hieu Hoang
403a473222
utf8 encoding
2014-05-22 21:23:31 +01:00
Hieu Hoang
3df23ea6ad
utf8 encoding
2014-05-22 19:00:36 +01:00
Hieu Hoang
7ec0c53e92
generic parallization that take stdin and output to stdout. For parsing
2014-05-22 15:22:55 +01:00
Hieu Hoang
d97be10a27
generic parallization that take stdin and output to stdout. For parsing
2014-05-22 14:38:27 +01:00
Hieu Hoang
b6d47733da
remove duplicate spaces caused when XML are stripped
2014-01-24 18:09:55 +00:00
Hieu Hoang
19aa8c1056
changes to moses-parallel.pl to make it work. /Thomas Meyer
2013-12-05 12:23:40 +00:00
Rico Sennrich
7138056b8f
flexibility scores
2013-09-07 23:04:01 +02:00
Hieu Hoang
ac50d9f349
Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input
2013-08-01 16:55:46 +01:00
Hieu Hoang
f234aa203f
number recognizer treats each word as atomic, replace all of the word or nothing at all. Recognizer is designed to be run after the text has been tokenized, not before
2013-08-01 16:55:11 +01:00
Hieu Hoang
4bc7ce99ed
add script to strip xml
2013-07-29 11:27:13 +01:00
Hieu Hoang
a3e3289b08
In corpus mode, replace number with number symbol
2013-07-25 15:54:47 +01:00
Hieu Hoang
78381d0213
@NUM@ --> @num@. In case using recaser
2013-07-25 15:16:15 +01:00
Hieu Hoang
6fc21a32fc
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-07-24 19:01:57 +01:00
Hieu Hoang
c104dee3b2
merge glue grammars, rather than writing them all to the same file. Required by Phil Williams & others when doing syntax extraction
2013-07-24 19:01:46 +01:00
Achim Ruopp
1813f9784b
Additional factoring to allow more NE recognizers; bug fixes
2013-07-24 12:44:53 -04:00
unknown
54eb50523b
Converted into modulino; added support for French numbers
2013-07-19 14:41:01 -04:00
Hieu Hoang
4e4cf1e313
script to replace numbers with placeholder. /Achim Ruopp
2013-07-01 23:00:59 +01:00
Wilker Aziz
f3cd72537c
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2013-06-24 15:39:18 +01:00
Wilker Aziz
b49e6a162f
Wrapper to lmplz
2013-06-24 12:20:20 +01:00
Hieu Hoang
a85f819a53
superceded
2013-06-24 11:33:11 +01:00
Ondrej Bojar
93433cf015
support --translation-details OUTFILE in moses-parallel
2013-04-03 18:10:44 +02:00
Hieu Hoang
1b83b85f44
debug info from sort command
2013-03-18 16:48:40 +00:00
phikoehn
3a7f4f776a
minor
2013-03-13 17:54:29 +00:00
phikoehn
d5cf38cab2
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-01-14 19:23:02 +00:00
phikoehn
344b150372
bug fixes with escaping / truecasing interactions
2013-01-14 19:22:29 +00:00
Barry Haddow
459acf87b1
Add support for instance weights file
2013-01-04 14:55:24 +00:00
phikoehn
b275c94dbf
allow for inclusion of extract from previous run
2012-12-12 07:02:59 +00:00
Hieu Hoang
487822ed14
don't write to stdout
2012-11-22 15:08:00 +00:00
phikoehn
5cd614ecd8
adjust to irstlm changes
2012-11-20 17:18:57 +00:00
Hieu Hoang
f3ec76ac56
minor change to calling irst training
2012-10-14 19:51:46 +01:00
phikoehn
04544f8bfc
better error message when reference file not found
2012-10-04 23:22:19 +01:00
Lane Schwartz
7b042edc6c
Send stderr to /dev/null when looking for pawd.
...
This cleans up the logs a bit for those of us who don't have pawd.
Otherwise, messages like the following show up in the logs:
/usr/bin/which: no pawd in ...
2012-09-28 14:55:09 -04:00
Lane Schwartz
a323c8daf7
Send stderr to /dev/null when looking for pawd.
...
This cleans up the logs a bit for those of us who don't have pawd.
Otherwise, messages like the following show up in the logs:
/usr/bin/which: no pawd in ...
bash: pawd: command not found
2012-09-28 14:37:53 -04:00
phikoehn
a84fbcb80a
bug fix for using domain feature in multi-process extract
2012-09-24 11:14:36 +01:00
Hieu Hoang
30e5b0575b
merge conflict
2012-09-03 19:12:00 +01:00
phikoehn
4a1a995878
a lot of changes
2012-08-18 23:48:26 +01:00
phikoehn
366ab93f8a
a lot of changes
2012-08-18 23:47:05 +01:00
Hieu Hoang
a8117c0afd
redirect more to stderr. Split input extract files every 50m lines, instead of 10m lines
2012-08-08 14:15:31 +01:00
Hieu Hoang
efdb983e0c
redirect parallel scoring to standard err, appending to existing
2012-08-07 15:38:42 +01:00
Hieu Hoang
a1ab8e354a
cleanup of variables. Need to delete temporary files
2012-07-31 02:21:48 +01:00
Hieu Hoang
23bbf12752
redirect stderr from extract program to stderr of script that runs it, for easier debugging
2012-07-18 22:53:47 +01:00
Hieu Hoang
f0a3e67717
redirect stderr from extract program to stderr of script that runs it, for easier debugging. Recursive create of output directory, in case output directory doesn't exist
2012-07-18 22:33:49 +01:00