Hieu Hoang
112b4c768d
use FindBin() to get directory of moses exec. Get ini file from command line, not hardcoded
2012-06-20 14:20:29 +01:00
Hieu Hoang
3fb69b686b
fixed segfault when pt is empty
2012-06-18 15:52:20 +01:00
Rico Sennrich
e5bec4a48b
minor fix for hierarchical sigtest filter
...
(rules that end with two nonterminals were all thrown out)
2012-06-16 08:38:43 +02:00
Hieu Hoang
5a7db584b8
Merge https://github.com/moses-smt/mosesdecoder
2012-06-16 00:46:03 +01:00
Hieu Hoang
e71f76a3e5
delete unused function
2012-06-16 00:38:50 +01:00
Hieu Hoang
454ef13442
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-06-16 00:22:01 +01:00
Hieu Hoang
d59e032402
up regression test number
2012-06-16 00:20:38 +01:00
Christophe Servan
04f10eba6d
Add some comments to take account of previous Hieu's move of the c++ code from the training directory to the root directory
2012-06-16 00:53:28 +03:00
Hieu Hoang
e72670700a
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-06-15 22:49:22 +01:00
Hieu Hoang
d2416bbe26
up version number
2012-06-15 22:35:57 +01:00
Hieu Hoang
6297c67fb2
Binary pt works with factors and chart decoding
2012-06-15 22:32:00 +01:00
Hieu Hoang
6096f21740
factors in chart decoding runs. But target factor model has incorrect LM score
2012-06-15 21:44:45 +01:00
Rico Sennrich
3549464943
bugfix (hierarchical sigtest filter failed for two consecutive nonterminals)
2012-06-15 18:42:34 +02:00
Rico Sennrich
9a0426543b
sigtest-filter for hierarchical rule tables
...
-h to enable:
split rules into terminal sequences, look up each in the suffix array,
and treat the intersection of the resulting sentence lists
as occurrences of the rule.
for a speedup, use unordered_set instead of set for SentIdSet
(requires GCC >= 4.3)
2012-06-15 10:23:52 +02:00
Colin Cherry
a8a5f896db
Fixed some bugs in BatchMira's sparse feature handling.
2012-06-14 14:09:06 -04:00
Hieu Hoang
137d351621
xcode
2012-06-13 15:56:53 +01:00
Hieu Hoang
018b0bbac0
Loosing factor checking for chart decoding
2012-06-13 15:08:03 +01:00
Colin Cherry
742f2d047f
Fixed a bug in --return-best-dev
2012-06-12 23:02:04 -04:00
Colin Cherry
4d284b25ad
Added --return-best-dev to mert-moses.pl
...
Copies the run*.moses.ini with the highest development BLEU to
moses.ini, instead of copying the weights from the last run of
optimization.
Recommended when using kbmira (and probably pro).
2012-06-12 09:16:11 -04:00
Tetsuo Kiso
1dbd8e5ec5
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-06-09 19:33:31 +09:00
Tetsuo Kiso
2599ef6dc3
Bug fix: kbmira failed to load dense weights.
2012-06-09 18:03:12 +09:00
Hieu Hoang
eaefd61bc9
minor warning
2012-06-08 17:30:40 +01:00
Hieu Hoang
0e621fe2d3
gzip grammar files
2012-06-08 00:43:47 +01:00
Hieu Hoang
22c038d93a
take out debugging info
2012-06-08 00:20:49 +01:00
Hieu Hoang
01b84656bf
default pt implementation if no phrase table specified
2012-06-08 00:19:56 +01:00
Hieu Hoang
82ca9fba69
delete example suffix array files
2012-06-07 19:40:10 +01:00
Hieu Hoang
03ce774d0e
suffix array creation script also creates glue grammar
2012-06-07 19:37:11 +01:00
Hieu Hoang
66800a3907
various filtered moses.ini work now
2012-06-07 18:43:51 +01:00
Hieu Hoang
842d1cb6fd
Merge github.com:moses-smt/mosesdecoder
2012-06-07 17:54:11 +01:00
Hieu Hoang
21c80f4fbe
pass number of ff from experiment.perl to train-model.perl for suffix array only
2012-06-07 17:53:52 +01:00
Hieu Hoang
5b7a9d5375
warning - undefined variablr
2012-06-07 16:14:12 +01:00
Hieu Hoang
e9c33669eb
apply previous commit to TUNING:filter step
2012-06-07 16:01:19 +01:00
Hieu Hoang
05fc5ffce3
phrase table type deduced in experiment.perl. Passed to train-model.perl
2012-06-07 15:46:58 +01:00
Hieu Hoang
0b59bee21c
sa extraction works
2012-06-06 19:17:21 +01:00
Hieu Hoang
797b36a73a
change output of build-suffix-array step to phrase-table.
2012-06-06 18:47:27 +01:00
Hieu Hoang
156b5db0fe
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-06-06 15:52:03 +01:00
Hieu Hoang
86a1886cb4
get rid of mention of --with-giza arg
2012-06-05 18:15:43 +01:00
Barry Haddow
175cd5754c
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-06-03 22:36:15 +01:00
Barry Haddow
25f5def387
Fix for case where no ttable is to be created
2012-06-03 22:03:41 +01:00
Tetsuo Kiso
35f4da44b8
Add a flag to set Batch MIRA's hyperparameters to mert-moses.pl.
...
- Add the descriptions to the usage.
- Initialize the variable $sum.
- Close file handle.
2012-06-02 19:55:56 +09:00
Hieu Hoang
019c138e69
Merge github.com:moses-smt/mosesdecoder
2012-06-01 22:22:54 +01:00
Barry Haddow
035c756c8c
ems requires external-bin-dir
2012-06-01 20:47:18 +01:00
Hieu Hoang
c6756f8301
start integrating adam's suffix array
2012-06-01 19:28:22 +01:00
Barry Haddow
18af87c72b
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-06-01 16:29:11 +01:00
Barry Haddow
47a6ee71cd
Update regression testing to work with new build layout.
...
Added the extract test to suite.
Disabled extract-rules test for now, since it fails.
Removed run-test-suite.perl, since tests are run with bjam.
2012-06-01 16:27:59 +01:00
Hieu Hoang
f0f4893a3d
start integrating adam's suffix array
2012-06-01 16:18:34 +01:00
Hieu Hoang
86666c2a1f
start integrating adam's suffix array
2012-06-01 16:06:37 +01:00
Hieu Hoang
a912bb6675
Merge github.com:moses-smt/mosesdecoder
2012-06-01 14:34:57 +01:00
Hieu Hoang
7e546e1529
-external-bin-dir is not required if not running mkcls or giza/mgiza. Convert relative to absoluate paths using File::Spec::Unix
2012-06-01 14:11:38 +01:00
Barry Haddow
7a78e2d0f7
Add option just to give counts
2012-06-01 13:42:00 +01:00