Commit Graph

718 Commits

Author SHA1 Message Date
Barry Haddow
3a6829ee5e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-01-31 15:14:08 +00:00
Barry Haddow
e1ef27f305 error checking 2012-01-31 15:13:59 +00:00
Hieu Hoang
6c607a17ff undo start-translation-id arg, as per email from Sandra Noubours 2012-01-26 21:24:05 +07:00
Hieu Hoang
a6d7d21ed4 rollback accidental commit 2012-01-24 18:04:44 +07:00
Hieu Hoang
79c6528a51 add --sort-batch-size arg to train-model.perl 2012-01-24 18:00:45 +07:00
phikoehn
a822db95db Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-01-24 10:14:04 +00:00
phikoehn
2a97c6bed2 added comments to config files 2012-01-24 10:13:19 +00:00
Phil Williams
99cd21f3e8 filter-rule-table.py: fix horribly inefficient filtering of rules that
contain frequently-occurring terminal sequences
(like [X] -> [X] , [X] , [X] , [X] and [X])
2012-01-23 10:57:56 +00:00
Barry Haddow
651fdba245 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-01-18 08:56:59 +00:00
Barry Haddow
83bb286809 Option to disable buffering (from Tom Hoar) 2012-01-18 08:55:12 +00:00
Eleftherios Avramidis
57688ae5b2 Catch errors produced after re-running on an existing run (with --continue) 2012-01-16 16:42:19 +01:00
Eleftherios Avramidis
1022a53760 Merge commit 'upstream/master' 2012-01-14 00:22:57 +01:00
Eleftherios Avramidis
8dd5c7bf2b Catch error, when for some reason train-model.perl is missing from installation (not properly compiled Moses) 2012-01-14 00:22:01 +01:00
Barry Haddow
5b1caea39c Merge pull request #7 from lefterav/master
METEOR support for EMS scripts
2012-01-12 10:22:48 -08:00
Eleftherios Avramidis
722c3ff6c7 Added support for optional external METEOR script. Workflow changes in experiment.meta and and corresponding sample given in example/config.basic. Results processing for report-experiment-scores now supports METEOR output. Lifted web interface restriction on the types of metrics that can be listed 2012-01-12 18:37:02 +01:00
bhaddow
fcbaafadbc Restore Hieu's phrase extraction speedups 2012-01-12 14:34:52 +00:00
phikoehn
9a5f61893a fixed ems bug when no interpolated LMs are used 2012-01-12 03:34:51 +00:00
pkoehn
7c44317216 bug fix with Good Turing / Kneser Ney discounting 2012-01-09 23:43:08 +00:00
Barry Haddow
3cabb98c40 bug fix to lex reordering training
submitted by Christoffer Tanner (via Sara Stymne)
2012-01-09 20:46:21 +00:00
Hieu Hoang
3aa77c1786 error message 2012-01-04 23:29:31 +07:00
Hieu Hoang
d0f91a6c89 support for mgiza, without having to install giza++ as well. By Marwen Azouzi 2012-01-03 22:14:57 +07:00
Hieu Hoang
c80ccc1557 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-12-29 19:48:03 +07:00
Hieu Hoang
776dfae384 observe max-phrase-length, as reported by Lang Jun 2011-12-29 19:47:44 +07:00
Hieu Hoang
97782ca1ea mgiza exec, according to Marwen Azouzi 2011-12-27 12:08:52 +07:00
cservan
232c092d70 update the script from the new mert-moses.pl 2011-12-23 13:34:19 +01:00
Philipp Koehn
9ad88ea09e allow for mix of interpolated and non-interpolated language models 2011-12-23 05:16:29 +00:00
Philipp Koehn
8d9c93e1aa allow for more than 10 language models by explicit or automatic grouping 2011-12-22 00:37:46 +00:00
Philipp Koehn
b9622d0da3 better error message when no corpus defined, better integration of IRSTLM training 2011-12-21 05:50:59 +00:00
Philipp Koehn
edd9c44519 updates to EMS: mteval-v13a.pl, parallel preparation, better paths and defaults in examples 2011-12-21 04:26:27 +00:00
Philipp Koehn
9ab5ac306b first cimmit to github: enable parallel data preparation in ems 2011-12-21 01:04:11 +00:00
Barry Haddow
96217a0985 Fix handling of scientific notation 2011-12-19 15:27:54 +00:00
bhaddow
cd7d629297 Add option to lowercase input 2011-12-16 17:00:13 +00:00
Hieu Hoang
753eebd959 revert 2011-12-12 20:48:42 +07:00
root
8327cce73b script to train LM with IRST in the EMS. A bit of a hack to make it look like SRI 2011-12-12 13:32:20 +07:00
Tetsuo Kiso
43e4aaceb7 Oops, forgot to move 'use strict' to the beginning of the script. 2011-12-09 02:39:02 +09:00
Tetsuo Kiso
5e45a34520 Minor change: make concatenatiton operations on filenames portable. 2011-12-09 02:14:41 +09:00
Tetsuo Kiso
ebdb4efd1b Fix bug on MERT Perl script when working directory is not specified.
If you set a working directory from the command line option,
the script works fine.

However, if you don't, the script will crash when calling a function
`create_extractor_script()' which creates shell script for the following
MERT iterations due to the inconsistency between path to default working
directory and Perl interpreter's current directory.

So, We assume that the default working directory used in the script
will be set to "`pwd`/mert-work".
2011-12-09 02:10:40 +09:00
Kenneth Heafield
2c53b59def Clean train-model-perl even if --with-giza isn't passed. 2011-12-05 11:01:34 +00:00
Kenneth Heafield
d6005b749a Change path to build_binary 2011-12-02 12:51:19 +00:00
Kenneth Heafield
a0d79781e5 Merge CreateOnDisk into OnDiskPt, pop out of src 2011-12-01 18:26:05 +00:00
Kenneth Heafield
3ea87b2d58 Assume people want all the executables and some examples installed. Also we're not in cvs anymore. 2011-11-30 15:22:21 -05:00
Kenneth Heafield
5eb8c37d00 Unbreak build darn globs 2011-11-30 15:01:08 -05:00
Kenneth Heafield
8373c36685 If it looks like a script, install it 2011-11-30 16:00:33 +00:00
Kenneth Heafield
04dbfc3933 Trigger biconcor compilation 2011-11-30 15:23:13 +00:00
Hieu Hoang
46084fd2db Merge branch 'master' of github.com:moses-smt/mosesdecoder 2011-11-30 14:30:09 +07:00
Hieu Hoang
038892601e reminder of language codes 2011-11-30 14:29:34 +07:00
Barry Haddow
2f95de8bb1 Merge pull request #4 from myGengo/master
Recaser training script improved with --help output and better error handling
2011-11-29 13:33:45 -08:00
Kenneth Heafield
e57d951152 Fix symal install location 2011-11-29 16:14:38 +00:00
Kenneth Heafield
17f8ab23b7 More instructions on giza 2011-11-28 14:20:25 -05:00
Kenneth Heafield
9ba60430e5 chmod +x train-model.perl 2011-11-27 16:52:40 +00:00