Commit Graph

4182 Commits

Author SHA1 Message Date
Hieu Hoang
112b4c768d use FindBin() to get directory of moses exec. Get ini file from command line, not hardcoded 2012-06-20 14:20:29 +01:00
Hieu Hoang
3fb69b686b fixed segfault when pt is empty 2012-06-18 15:52:20 +01:00
Rico Sennrich
e5bec4a48b minor fix for hierarchical sigtest filter
(rules that end with two nonterminals were all thrown out)
2012-06-16 08:38:43 +02:00
Hieu Hoang
5a7db584b8 Merge https://github.com/moses-smt/mosesdecoder 2012-06-16 00:46:03 +01:00
Hieu Hoang
e71f76a3e5 delete unused function 2012-06-16 00:38:50 +01:00
Hieu Hoang
454ef13442 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-16 00:22:01 +01:00
Hieu Hoang
d59e032402 up regression test number 2012-06-16 00:20:38 +01:00
Christophe Servan
04f10eba6d Add some comments to take account of previous Hieu's move of the c++ code from the training directory to the root directory 2012-06-16 00:53:28 +03:00
Hieu Hoang
e72670700a Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-15 22:49:22 +01:00
Hieu Hoang
d2416bbe26 up version number 2012-06-15 22:35:57 +01:00
Hieu Hoang
6297c67fb2 Binary pt works with factors and chart decoding 2012-06-15 22:32:00 +01:00
Hieu Hoang
6096f21740 factors in chart decoding runs. But target factor model has incorrect LM score 2012-06-15 21:44:45 +01:00
Rico Sennrich
3549464943 bugfix (hierarchical sigtest filter failed for two consecutive nonterminals) 2012-06-15 18:42:34 +02:00
Rico Sennrich
9a0426543b sigtest-filter for hierarchical rule tables
-h to enable:
split rules into terminal sequences, look up each in the suffix array,
and treat the intersection of the resulting sentence lists
as occurrences of the rule.

for a speedup, use unordered_set instead of set for SentIdSet
(requires GCC >= 4.3)
2012-06-15 10:23:52 +02:00
Colin Cherry
a8a5f896db Fixed some bugs in BatchMira's sparse feature handling. 2012-06-14 14:09:06 -04:00
Hieu Hoang
137d351621 xcode 2012-06-13 15:56:53 +01:00
Hieu Hoang
018b0bbac0 Loosing factor checking for chart decoding 2012-06-13 15:08:03 +01:00
Colin Cherry
742f2d047f Fixed a bug in --return-best-dev 2012-06-12 23:02:04 -04:00
Colin Cherry
4d284b25ad Added --return-best-dev to mert-moses.pl
Copies the run*.moses.ini with the highest development BLEU to
moses.ini, instead of copying the weights from the last run of
optimization.
Recommended when using kbmira (and probably pro).
2012-06-12 09:16:11 -04:00
Tetsuo Kiso
1dbd8e5ec5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-09 19:33:31 +09:00
Tetsuo Kiso
2599ef6dc3 Bug fix: kbmira failed to load dense weights. 2012-06-09 18:03:12 +09:00
Hieu Hoang
eaefd61bc9 minor warning 2012-06-08 17:30:40 +01:00
Hieu Hoang
0e621fe2d3 gzip grammar files 2012-06-08 00:43:47 +01:00
Hieu Hoang
22c038d93a take out debugging info 2012-06-08 00:20:49 +01:00
Hieu Hoang
01b84656bf default pt implementation if no phrase table specified 2012-06-08 00:19:56 +01:00
Hieu Hoang
82ca9fba69 delete example suffix array files 2012-06-07 19:40:10 +01:00
Hieu Hoang
03ce774d0e suffix array creation script also creates glue grammar 2012-06-07 19:37:11 +01:00
Hieu Hoang
66800a3907 various filtered moses.ini work now 2012-06-07 18:43:51 +01:00
Hieu Hoang
842d1cb6fd Merge github.com:moses-smt/mosesdecoder 2012-06-07 17:54:11 +01:00
Hieu Hoang
21c80f4fbe pass number of ff from experiment.perl to train-model.perl for suffix array only 2012-06-07 17:53:52 +01:00
Hieu Hoang
5b7a9d5375 warning - undefined variablr 2012-06-07 16:14:12 +01:00
Hieu Hoang
e9c33669eb apply previous commit to TUNING:filter step 2012-06-07 16:01:19 +01:00
Hieu Hoang
05fc5ffce3 phrase table type deduced in experiment.perl. Passed to train-model.perl 2012-06-07 15:46:58 +01:00
Hieu Hoang
0b59bee21c sa extraction works 2012-06-06 19:17:21 +01:00
Hieu Hoang
797b36a73a change output of build-suffix-array step to phrase-table. 2012-06-06 18:47:27 +01:00
Hieu Hoang
156b5db0fe Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-06 15:52:03 +01:00
Hieu Hoang
86a1886cb4 get rid of mention of --with-giza arg 2012-06-05 18:15:43 +01:00
Barry Haddow
175cd5754c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-03 22:36:15 +01:00
Barry Haddow
25f5def387 Fix for case where no ttable is to be created 2012-06-03 22:03:41 +01:00
Tetsuo Kiso
35f4da44b8 Add a flag to set Batch MIRA's hyperparameters to mert-moses.pl.
- Add the descriptions to the usage.
- Initialize the variable $sum.
- Close file handle.
2012-06-02 19:55:56 +09:00
Hieu Hoang
019c138e69 Merge github.com:moses-smt/mosesdecoder 2012-06-01 22:22:54 +01:00
Barry Haddow
035c756c8c ems requires external-bin-dir 2012-06-01 20:47:18 +01:00
Hieu Hoang
c6756f8301 start integrating adam's suffix array 2012-06-01 19:28:22 +01:00
Barry Haddow
18af87c72b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-06-01 16:29:11 +01:00
Barry Haddow
47a6ee71cd Update regression testing to work with new build layout.
Added the extract test to suite.
Disabled extract-rules test for now, since it fails.
Removed run-test-suite.perl, since tests are run with bjam.
2012-06-01 16:27:59 +01:00
Hieu Hoang
f0f4893a3d start integrating adam's suffix array 2012-06-01 16:18:34 +01:00
Hieu Hoang
86666c2a1f start integrating adam's suffix array 2012-06-01 16:06:37 +01:00
Hieu Hoang
a912bb6675 Merge github.com:moses-smt/mosesdecoder 2012-06-01 14:34:57 +01:00
Hieu Hoang
7e546e1529 -external-bin-dir is not required if not running mkcls or giza/mgiza. Convert relative to absoluate paths using File::Spec::Unix 2012-06-01 14:11:38 +01:00
Barry Haddow
7a78e2d0f7 Add option just to give counts 2012-06-01 13:42:00 +01:00