Commit Graph

10899 Commits

Author SHA1 Message Date
Hieu Hoang
9cdcf713a6 phrase penalty now has it's own ff. No longer in the phrase table 2013-07-29 12:55:44 +01:00
Hieu Hoang
e33f8506f8 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-07-29 11:44:12 +01:00
Hieu Hoang
2980dde163 add script to strip xml 2013-07-29 11:44:00 +01:00
Hieu Hoang
4bc7ce99ed add script to strip xml 2013-07-29 11:27:13 +01:00
Hieu Hoang
c449610aaf Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-07-28 22:52:21 +01:00
Ulrich Germann
cb1c06d502 Merge branch 'master' of github.com:moses-smt/mosesdecoder
Conflicts:
	moses/Jamfile
2013-07-28 16:51:13 +01:00
Ulrich Germann
56bb485dd5 Fixed missing #include. 2013-07-28 16:39:13 +01:00
Ulrich Germann
b3ed0d56d7 Fixed missing #include. 2013-07-28 16:38:33 +01:00
Ulrich Germann
a47b6cfafa Added call to tp->Evaluate(src) before adding a phrase table entry to the TargetPhraseCollection during lookup. 2013-07-28 16:37:20 +01:00
Ulrich Germann
1b1771dcc9 Items under 'generic' now included in libmoses' 2013-07-28 16:30:41 +01:00
Ulrich Germann
a0c13837e0 Fixed computation of lexical scores. 2013-07-28 16:28:41 +01:00
Hieu Hoang
ff4c4339bd if using CreateOnDiskPt to binarize pt, use processLexicalTable to binarize reordering table. HACK 2013-07-28 12:00:35 +01:00
Hieu Hoang
86fe9fa6b3 Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-07-27 10:15:39 +01:00
Hieu Hoang
abe90b5af7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-27 04:19:16 +01:00
Hieu Hoang
9dab7950fa move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 04:18:50 +01:00
Hieu Hoang
4ea975e108 move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 03:58:27 +01:00
Hieu Hoang
90651a9b22 move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 03:57:05 +01:00
Hieu Hoang
0b23a0e327 rollback excluding translation options that have incompatible alignments for placeholders. This should be exclude at the training step 2013-07-26 19:39:10 +01:00
Hieu Hoang
9e8402dedd add placeholder support to extract 2013-07-26 15:46:15 +01:00
Hieu Hoang
e3917f911b add placeholder support to extract 2013-07-26 15:44:29 +01:00
Hieu Hoang
89058b7935 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-07-26 15:25:53 +01:00
Hieu Hoang
6be88d3f44 update filtering script to correct binarize pb models with CreateOnDiskPt 2013-07-26 15:12:15 +01:00
Hieu Hoang
efd9789577 update filtering script to correct binarize pb models with CreateOnDiskPt 2013-07-26 15:06:07 +01:00
Hieu Hoang
2ba7a372e8 add placeholder support to extract 2013-07-26 14:12:27 +01:00
Hieu Hoang
d1700435e0 eclipse file for extract 2013-07-26 14:00:19 +01:00
Hieu Hoang
4fde5f7ea2 eclipse file for extract-rules 2013-07-26 12:27:55 +01:00
Hieu Hoang
9451f5df98 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:57:21 +01:00
Hieu Hoang
38e312f44c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:55:16 +01:00
Barry Haddow
29aa9ea153 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:56:44 +01:00
Barry Haddow
c127c58e9b fix to single thread build 2013-07-25 15:56:20 +01:00
Hieu Hoang
a3e3289b08 In corpus mode, replace number with number symbol 2013-07-25 15:54:47 +01:00
Hieu Hoang
2aef439d8a Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:26:38 +01:00
Barry Haddow
7081f06413 Fixes to the shared build 2013-07-25 15:24:34 +01:00
Hieu Hoang
76a9730ca8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:23:12 +01:00
Hieu Hoang
e2c2bc59f1 beautify 2013-07-25 15:23:05 +01:00
Hieu Hoang
60478e5693 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:16:22 +01:00
Hieu Hoang
78381d0213 @NUM@ --> @num@. In case using recaser 2013-07-25 15:16:15 +01:00
Phil Williams
f0b603e6b5 extract-ghkm: write glue grammars for all sentence offsets
extract-parallel now merges separate glue grammars, so remove
previous workaround.
2013-07-25 13:53:32 +01:00
Hieu Hoang
4637f03278 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 12:59:42 +01:00
Hieu Hoang
d0172ed5cd create script to convert phrase-table with alignment in Moses' dead-end format to standard format 2013-07-25 12:56:20 +01:00
Hieu Hoang
018998247a create script to convert phrase-table with alignment in Moses' dead-end format to standard format 2013-07-25 12:52:05 +01:00
Hieu Hoang
07693a3f96 Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 08:42:24 +01:00
Hieu Hoang
c0aba71c79 bug processing unknown word with digits 2013-07-25 08:41:59 +01:00
Hieu Hoang
c2489c7d8b merge 2013-07-24 21:48:14 +01:00
Barry Haddow
f79746b3c2 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-24 20:49:59 +01:00
Hieu Hoang
6ac4d4ddad Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-24 19:04:54 +01:00
Hieu Hoang
6fc21a32fc Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-24 19:01:57 +01:00
Hieu Hoang
c104dee3b2 merge glue grammars, rather than writing them all to the same file. Required by Phil Williams & others when doing syntax extraction 2013-07-24 19:01:46 +01:00
Hieu Hoang
62e9689e1e Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-07-24 18:07:08 +01:00
Hieu Hoang
8ffd53e321 create target phrases, not Translation Options, for XML. Can be used in both pb and scfg 2013-07-24 18:06:46 +01:00