Commit Graph

9608 Commits

Author SHA1 Message Date
amittai
225feafb9e Merge remote-tracking branch 'upstream/master' into amittai 2013-02-26 11:23:33 -08:00
amittai
1fb51dc674 use 'gunzip -c' instead of 'zcat' for better cross-platform compatibility
zcat is identical to "gunzip -c", but Mac OS X doesn't ship with zcat.
2013-02-26 11:19:33 -08:00
Hieu Hoang
1ee365e0d7 WIP. Fix for incorrect alignment from moses_chart 2013-02-26 18:27:55 +00:00
Hieu Hoang
1bba58b134 eclipse project files 2013-02-26 11:01:01 +00:00
amittai
8b6e98c633 Revert "let's be consistently case-insensitive with respect to the xml tags"
This reverts commit 2eb0c5e11d.
2013-02-24 18:10:19 -08:00
amittai
2eb0c5e11d let's be consistently case-insensitive with respect to the xml tags 2013-02-24 18:07:11 -08:00
Lane Schwartz
4adeb7e338 Output feature weights to a separate file when producing hypergraph 2013-02-22 16:28:48 -05:00
Lane Schwartz
285661fec7 Deleted stale commented code 2013-02-22 16:28:48 -05:00
Lane Schwartz
764ce06726 More work on outputting search graph as hypergraph 2013-02-22 16:28:48 -05:00
Lane Schwartz
04f107fbb0 Add flag to output search graph in Kenneth's hypergraph format. 2013-02-22 16:28:48 -05:00
Lane Schwartz
e7563111de More work on outputting HTK lattice format 2013-02-22 16:28:47 -05:00
Lane Schwartz
e106e04dc3 More work on outputting HTK SLF.
Now, each arc emits exactly one word.
2013-02-22 16:28:47 -05:00
Lane Schwartz
774ed64f2e Work to allow output search graph in HTK standard lattice format 2013-02-22 16:28:47 -05:00
Hieu Hoang
5844fb21a7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-02-20 16:56:54 +00:00
Hieu Hoang
101c719695 add word alignment for OOV too. Exist for pb but not hiero model 2013-02-20 16:56:36 +00:00
Barry Haddow
0327a8cfcd Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-02-20 11:14:31 +00:00
marcinj
10c1785226 Added missing function call to for sort order check 2013-02-20 11:03:57 +01:00
Barry Haddow
9ca364fb22 Implement brevity penalty smoothing for PRO
As in Nakov et al (Coling 2012)
2013-02-18 11:11:20 +00:00
Lane Schwartz
2e6b5e7a23 Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder 2013-02-14 12:03:35 -05:00
Kenneth Heafield
8ef095e8fa Update incremental search, cuts runtime by a third 2013-02-14 13:11:53 +00:00
marcinj
10012fac15 Fixed missing last source phrase and added workaround for single key cmph hash functions 2013-02-14 13:22:19 +01:00
Lane Schwartz
f9a46adc31 Specify -start-translation-id to tell Moses the line number of the first sentence 2013-02-13 15:52:40 -05:00
Hieu Hoang
07cd76136a distinct nbest works the old way 2013-02-13 14:02:22 +00:00
Hieu Hoang
b84112a4b7 distinct nbest works the old way 2013-02-13 14:01:50 +00:00
Hieu Hoang
1a8cd20b51 -print-id for christian buck and phi 2013-02-11 18:01:33 +00:00
Rico Sennrich
e3ea93acb7 speed up rule extraction by factor 2 (by rewriting rule consolidation to have linear instead of quadratic complexity) 2013-02-06 13:10:38 +01:00
Rico Sennrich
50a8e94a8f tmcombine: better error message for unsupported phrase tables 2013-02-05 11:44:50 +01:00
Ales Tamchyna
2b7725db34 support LM OOV feature in train-model.perl 2013-02-01 15:47:05 +01:00
Kenneth Heafield
03b077364a KenLM 31a6644 resizable probing hash table, build fixes 2013-01-24 12:07:46 +00:00
Kenneth Heafield
22bf1c77e9 Ales Tamchyna patch for ancient Boost. 2013-01-23 13:28:15 +00:00
Marcin Junczys-Dowmunt
4cc23d233d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-01-22 22:13:35 +01:00
Marcin Junczys-Dowmunt
d87c7c4d34 Added normalization of temporary directory path 2013-01-22 22:12:08 +01:00
Kenneth Heafield
e2fc306231 KenLM 58da33: compiler warnings, correctly handle bare K, kill HAVE_BOOST 2013-01-22 20:23:35 +00:00
Marcin Junczys-Dowmunt
fcf75fae18 Added option to specify directory or prefix for temporary files created during phrase table compacting 2013-01-22 21:11:02 +01:00
Kenneth Heafield
cfe7d00ea2 Compiler warnings, rename to ${binary}_main.cc 2013-01-20 13:43:19 +00:00
Kenneth Heafield
a52d97f99f Cross platform fixes 2013-01-20 12:25:58 +00:00
Hieu Hoang
8a3b93c72e compile error on mac 2013-01-20 11:52:18 +00:00
Hieu Hoang
b6fd7bf994 eclipse 2013-01-19 18:43:58 +00:00
Tetsuo Kiso
8b4a1fa2b8 Fix MegaM's URL.
Because I got a 404 error.
2013-01-20 02:30:20 +09:00
Kenneth Heafield
a35299497f Tolerate odd characters in corpora. 2013-01-19 13:35:00 +00:00
Hieu Hoang
10d7f3654e compile error when single threading 2013-01-18 16:31:55 +00:00
Kenneth Heafield
fc5868d0ff KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
Kenneth Heafield
5f7b91e702 Workaround for bjam inverting argument order 2013-01-18 13:40:56 +00:00
Kenneth Heafield
a7731ce432 KenLM 014bced6 2013-01-17 11:58:58 +00:00
Hieu Hoang
8af1d6a017 Merge pull request #26 from amittai/amittai
updated Windows instructions slightly; also .gitignore should ignore the...
2013-01-16 03:57:56 -08:00
amittai
176647e342 accept either "mgiza" or "mgizapp" and either "snt2cooc.out" or "snt2cooc"
Fixed a mismatch between the wiki and mgiza.

Installing mgiza produces a file called "mgiza".
However, the Moses instructions on the wiki here
http://www.statmt.org/moses/?n=Moses.ExternalTools#mgiza
insist that the "mgiza" binary be renamed "mgizapp", but then
train-experiment.perl only accepts the binary called "mgiza".
2013-01-15 19:11:49 -08:00
amittai
85b17db8e6 updated Windows instructions slightly; also .gitignore should ignore the sentence-bleu binary. 2013-01-15 18:34:33 -08:00
phikoehn
124c36a837 bug fix with MML settings 2013-01-14 19:39:26 +00:00
phikoehn
a7f7379fa4 fixed bug in detruecaser / interaction with esacping 2013-01-14 19:25:43 +00:00
phikoehn
d5cf38cab2 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2013-01-14 19:23:02 +00:00