Commit Graph

3273 Commits

Author SHA1 Message Date
Phil Williams
f0d4b37255 Add --GZOutput option to extract-ghkm. 2012-05-15 20:00:38 +01:00
Hieu Hoang
1307342036 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-15 16:47:00 +01:00
Hieu Hoang
f408401ff7 Add util for querying on-disk pt 2012-05-15 16:46:16 +01:00
Hieu Hoang
9467cc82e6 Add util for querying on-disk pt 2012-05-15 16:35:00 +01:00
Hieu Hoang
3454617467 Add util for querying on-disk pt 2012-05-15 16:17:06 +01:00
Hieu Hoang
7ef9b5c635 Add util for querying on-disk pt 2012-05-15 16:16:16 +01:00
Hieu Hoang
f44e16d1fc Add util for querying on-disk pt 2012-05-15 16:03:40 +01:00
Hieu Hoang
8eede65114 bug. Unknown words given id starting from 1 2012-05-15 15:43:01 +01:00
Hieu Hoang
ac1492e17b Add util for querying on-disk pt 2012-05-15 15:19:23 +01:00
Hieu Hoang
5e889f70f8 Add util for querying on-disk pt 2012-05-15 15:17:59 +01:00
Hieu Hoang
045f4965ad Add util for querying on-disk pt 2012-05-15 15:06:25 +01:00
Hieu Hoang
b8f6958df0 begin adding util for querying on-disk pt. For Daniel Schaut 2012-05-15 14:35:31 +01:00
Matous Machacek
7da028e240 Fixed CderScorer name bug 2012-05-15 00:35:08 +02:00
Hieu Hoang
d04420a65d Begin integrating Adam's suffix arrays into EMS 2012-05-14 19:44:53 +01:00
Hieu Hoang
92fe4ac1af Begin integrating Adam's suffix arrays into EMS 2012-05-14 18:56:10 +01:00
Hieu Hoang
d3f6c965a8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-13 19:25:01 +01:00
Hieu Hoang
b018a65f30 use sort args in extract-parallel too. Change hiero extraction to new procedure too 2012-05-13 19:23:10 +01:00
Tetsuo Kiso
5252ca94d0 Force shared linkage only for clang-linux.
bjam's support for clang on Linux is buggy.
The support for clang on Darwin (Mac OS X) looks fine.
2012-05-13 21:02:27 +09:00
Hieu Hoang
db445d92f8 add -sort-compress arg to train-model.perl. Wrapper for gsort --compress-program 2012-05-13 11:06:02 +01:00
Hieu Hoang
32c72a305d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-13 10:57:34 +01:00
Hieu Hoang
299e0555b9 use new gzipped extract file. Always save extract files already sorted 2012-05-13 10:54:08 +01:00
Hieu Hoang
e74f67abc5 use new gzipped extract file. Always save extract files already sorted 2012-05-13 10:23:59 +01:00
Matous Machacek
7a0c42b1bb Fixed bug in SemposScorer.cpp 2012-05-13 11:11:13 +02:00
Hieu Hoang
066c209fcb use new gzipped extract file. Always save extract files already sorted 2012-05-12 15:41:07 +01:00
Matous Machacek
8343a469e0 Fixed interpolated scorer 2012-05-12 16:11:33 +02:00
Hieu Hoang
9c6c2ad84a write gzipped files if filename is *.gz. 2012-05-11 23:41:51 +01:00
Hieu Hoang
0cd472f229 delete test directory from repository 2012-05-11 23:02:09 +01:00
Hieu Hoang
99043441e6 delete test directory from repository 2012-05-11 21:40:08 +01:00
Hieu Hoang
ea8d6ed94e gzip output files from consolidate 2012-05-11 18:28:59 +01:00
Hieu Hoang
de8a2e7667 gzip output files from extract-rules 2012-05-11 18:18:01 +01:00
Hieu Hoang
8ff5030e33 gzip output files from extract 2012-05-11 18:10:54 +01:00
Hieu Hoang
5b0bd36fd1 NOTE: regression test data needs to be moved completely to download. It's too big for git. To do next week 2012-05-11 17:51:21 +01:00
Hieu Hoang
f4d7056bb1 regression test for extract(hiero) 2012-05-11 17:44:05 +01:00
Hieu Hoang
4f1f6b53d2 regression test for extract(hiero) 2012-05-11 17:04:23 +01:00
Hieu Hoang
414fe3e783 regression test for extract(hiero) 2012-05-11 17:03:27 +01:00
Hieu Hoang
133df206ee regression test for extract(hiero) 2012-05-11 17:02:52 +01:00
Hieu Hoang
28646259af extract regression test 2012-05-11 15:38:46 +01:00
Hieu Hoang
2e34bd7052 extract regression test 2012-05-11 15:21:52 +01:00
Hieu Hoang
2dc659daed extract regression test 2012-05-11 15:07:44 +01:00
Hieu Hoang
bc4c99a907 extract regression test 2012-05-11 14:23:29 +01:00
Hieu Hoang
069d24e9f5 zipped output file 2012-05-11 12:25:20 +01:00
Hieu Hoang
283ae161a6 zipped output file 2012-05-11 12:20:49 +01:00
Hieu Hoang
abf13f7e47 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-11 12:18:17 +01:00
Hieu Hoang
269aecccd0 zipped output file 2012-05-11 12:18:02 +01:00
Christian Federmann
9b5a4278b7 Rolled back unnecessary gzFile casts. 2012-05-11 08:41:55 +02:00
Hieu Hoang
5fb97e4d58 closing gz file 2012-05-10 23:49:15 +01:00
Kenneth Heafield
b64c182535 Force shared linkage with clang. 2012-05-10 13:15:12 -04:00
Hieu Hoang
2816586584 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:58:28 +01:00
Kenneth Heafield
55038fb959 And InputFileStream too 2012-05-10 12:56:52 -04:00
Hieu Hoang
7473514b56 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-10 17:52:06 +01:00