Commit Graph

9549 Commits

Author SHA1 Message Date
Lane Schwartz
04f107fbb0 Add flag to output search graph in Kenneth's hypergraph format. 2013-02-22 16:28:48 -05:00
Lane Schwartz
e7563111de More work on outputting HTK lattice format 2013-02-22 16:28:47 -05:00
Lane Schwartz
e106e04dc3 More work on outputting HTK SLF.
Now, each arc emits exactly one word.
2013-02-22 16:28:47 -05:00
Lane Schwartz
774ed64f2e Work to allow output search graph in HTK standard lattice format 2013-02-22 16:28:47 -05:00
Hieu Hoang
5844fb21a7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-02-20 16:56:54 +00:00
Hieu Hoang
101c719695 add word alignment for OOV too. Exist for pb but not hiero model 2013-02-20 16:56:36 +00:00
Barry Haddow
0327a8cfcd Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-02-20 11:14:31 +00:00
marcinj
10c1785226 Added missing function call to for sort order check 2013-02-20 11:03:57 +01:00
Barry Haddow
9ca364fb22 Implement brevity penalty smoothing for PRO
As in Nakov et al (Coling 2012)
2013-02-18 11:11:20 +00:00
Lane Schwartz
2e6b5e7a23 Merge branch 'master' of www:/repos/git/Decoders/mosesdecoder 2013-02-14 12:03:35 -05:00
Kenneth Heafield
8ef095e8fa Update incremental search, cuts runtime by a third 2013-02-14 13:11:53 +00:00
marcinj
10012fac15 Fixed missing last source phrase and added workaround for single key cmph hash functions 2013-02-14 13:22:19 +01:00
Lane Schwartz
f9a46adc31 Specify -start-translation-id to tell Moses the line number of the first sentence 2013-02-13 15:52:40 -05:00
Hieu Hoang
07cd76136a distinct nbest works the old way 2013-02-13 14:02:22 +00:00
Hieu Hoang
b84112a4b7 distinct nbest works the old way 2013-02-13 14:01:50 +00:00
Hieu Hoang
1a8cd20b51 -print-id for christian buck and phi 2013-02-11 18:01:33 +00:00
Rico Sennrich
e3ea93acb7 speed up rule extraction by factor 2 (by rewriting rule consolidation to have linear instead of quadratic complexity) 2013-02-06 13:10:38 +01:00
Rico Sennrich
50a8e94a8f tmcombine: better error message for unsupported phrase tables 2013-02-05 11:44:50 +01:00
Ales Tamchyna
2b7725db34 support LM OOV feature in train-model.perl 2013-02-01 15:47:05 +01:00
Kenneth Heafield
03b077364a KenLM 31a6644 resizable probing hash table, build fixes 2013-01-24 12:07:46 +00:00
Kenneth Heafield
22bf1c77e9 Ales Tamchyna patch for ancient Boost. 2013-01-23 13:28:15 +00:00
Marcin Junczys-Dowmunt
4cc23d233d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-01-22 22:13:35 +01:00
Marcin Junczys-Dowmunt
d87c7c4d34 Added normalization of temporary directory path 2013-01-22 22:12:08 +01:00
Kenneth Heafield
e2fc306231 KenLM 58da33: compiler warnings, correctly handle bare K, kill HAVE_BOOST 2013-01-22 20:23:35 +00:00
Marcin Junczys-Dowmunt
fcf75fae18 Added option to specify directory or prefix for temporary files created during phrase table compacting 2013-01-22 21:11:02 +01:00
Kenneth Heafield
cfe7d00ea2 Compiler warnings, rename to ${binary}_main.cc 2013-01-20 13:43:19 +00:00
Kenneth Heafield
a52d97f99f Cross platform fixes 2013-01-20 12:25:58 +00:00
Hieu Hoang
8a3b93c72e compile error on mac 2013-01-20 11:52:18 +00:00
Hieu Hoang
b6fd7bf994 eclipse 2013-01-19 18:43:58 +00:00
Tetsuo Kiso
8b4a1fa2b8 Fix MegaM's URL.
Because I got a 404 error.
2013-01-20 02:30:20 +09:00
Kenneth Heafield
a35299497f Tolerate odd characters in corpora. 2013-01-19 13:35:00 +00:00
Hieu Hoang
10d7f3654e compile error when single threading 2013-01-18 16:31:55 +00:00
Kenneth Heafield
fc5868d0ff KenLM df5be22 lmplz for estimation 2013-01-18 15:59:51 +00:00
Kenneth Heafield
5f7b91e702 Workaround for bjam inverting argument order 2013-01-18 13:40:56 +00:00
Kenneth Heafield
a7731ce432 KenLM 014bced6 2013-01-17 11:58:58 +00:00
Hieu Hoang
8af1d6a017 Merge pull request #26 from amittai/amittai
updated Windows instructions slightly; also .gitignore should ignore the...
2013-01-16 03:57:56 -08:00
amittai
176647e342 accept either "mgiza" or "mgizapp" and either "snt2cooc.out" or "snt2cooc"
Fixed a mismatch between the wiki and mgiza.

Installing mgiza produces a file called "mgiza".
However, the Moses instructions on the wiki here
http://www.statmt.org/moses/?n=Moses.ExternalTools#mgiza
insist that the "mgiza" binary be renamed "mgizapp", but then
train-experiment.perl only accepts the binary called "mgiza".
2013-01-15 19:11:49 -08:00
amittai
85b17db8e6 updated Windows instructions slightly; also .gitignore should ignore the sentence-bleu binary. 2013-01-15 18:34:33 -08:00
phikoehn
124c36a837 bug fix with MML settings 2013-01-14 19:39:26 +00:00
phikoehn
a7f7379fa4 fixed bug in detruecaser / interaction with esacping 2013-01-14 19:25:43 +00:00
phikoehn
d5cf38cab2 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2013-01-14 19:23:02 +00:00
phikoehn
344b150372 bug fixes with escaping / truecasing interactions 2013-01-14 19:22:29 +00:00
Kenneth Heafield
c9687e3b50 Fix longstanding bug in sentence splitter spacing.
"Foo Bar.  Baz Quux." is two sentences even though there are two spaces instead of one.
2013-01-11 13:32:24 +00:00
Rico Sennrich
647bc11c0a fix display of error message 2013-01-11 11:24:41 +01:00
Barry Haddow
8db90fd2ac instance weighting for lex reordering 2013-01-10 19:46:19 +00:00
Barry Haddow
ba0f4264bb Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-01-10 19:04:41 +00:00
Kenneth Heafield
2e5c1af5da Also ftruncate64 on android 2013-01-10 13:45:41 +00:00
Kenneth Heafield
f8b2b49afa Stupid android 64-bit file offsets, static assert sizeof(off_t) == 8 2013-01-10 13:32:17 +00:00
Hieu Hoang
fd9a39d655 Merge pull request #25 from neubig/ems-external-bin-dir
EMS should rerun mkcls and GIZA++ on change of external-bin-dir
2013-01-10 02:42:55 -08:00
Graham Neubig
c55a1474df Updated experiment.meta 2013-01-10 16:16:23 +09:00