Commit Graph

10710 Commits

Author SHA1 Message Date
Hieu Hoang
ba187294d5 begin cleanup of SCFG parsing. Get rid of Sentence variable in ChartRuleLookupManager, replace with ChartParser variable 2013-07-31 12:25:34 +01:00
Hieu Hoang
231c32fae9 create queue of InputPath objects. Starting SCFG parsing with lattices and conf net 2013-07-30 15:28:20 +01:00
Hieu Hoang
77872f7521 beautify 2013-07-30 15:04:37 +01:00
Hieu Hoang
1d40a604df create queue of InputPath objects. Starting SCFG parsing with lattices and conf net 2013-07-30 15:03:47 +01:00
Hieu Hoang
2e6266c85a Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-30 13:06:13 +01:00
Hieu Hoang
03f767ba84 Add debug out to support regression test on Ken's incremental search algorithm. Ken has his own hypothesis class... 2013-07-30 13:05:13 +01:00
Hieu Hoang
dadb66b17d Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-07-30 11:43:32 +01:00
Hieu Hoang
4101611271 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-30 11:43:19 +01:00
Hieu Hoang
b05a443f36 correct arguments to substitute-filtered-tables-and-weights.perl 2013-07-30 11:14:17 +01:00
Hieu Hoang
66349474d4 correct arguments to substitute-filtered-tables-and-weights.perl 2013-07-30 11:12:49 +01:00
Hieu Hoang
52ff87a6ce phrase penalty now has it's own ff. No longer in the phrase table 2013-07-29 17:51:20 +01:00
Hieu Hoang
9cdcf713a6 phrase penalty now has it's own ff. No longer in the phrase table 2013-07-29 12:55:44 +01:00
Hieu Hoang
e33f8506f8 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-07-29 11:44:12 +01:00
Hieu Hoang
2980dde163 add script to strip xml 2013-07-29 11:44:00 +01:00
Hieu Hoang
4bc7ce99ed add script to strip xml 2013-07-29 11:27:13 +01:00
Hieu Hoang
c449610aaf Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-07-28 22:52:21 +01:00
Ulrich Germann
cb1c06d502 Merge branch 'master' of github.com:moses-smt/mosesdecoder
Conflicts:
	moses/Jamfile
2013-07-28 16:51:13 +01:00
Ulrich Germann
56bb485dd5 Fixed missing #include. 2013-07-28 16:39:13 +01:00
Ulrich Germann
b3ed0d56d7 Fixed missing #include. 2013-07-28 16:38:33 +01:00
Ulrich Germann
a47b6cfafa Added call to tp->Evaluate(src) before adding a phrase table entry to the TargetPhraseCollection during lookup. 2013-07-28 16:37:20 +01:00
Ulrich Germann
1b1771dcc9 Items under 'generic' now included in libmoses' 2013-07-28 16:30:41 +01:00
Ulrich Germann
a0c13837e0 Fixed computation of lexical scores. 2013-07-28 16:28:41 +01:00
Hieu Hoang
ff4c4339bd if using CreateOnDiskPt to binarize pt, use processLexicalTable to binarize reordering table. HACK 2013-07-28 12:00:35 +01:00
Hieu Hoang
86fe9fa6b3 Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-07-27 10:15:39 +01:00
Hieu Hoang
abe90b5af7 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-27 04:19:16 +01:00
Hieu Hoang
9dab7950fa move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 04:18:50 +01:00
Hieu Hoang
4ea975e108 move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 03:58:27 +01:00
Hieu Hoang
90651a9b22 move closing of filtered file before binarizing. Otherwise file not flushed, causes error in binarizing 2013-07-27 03:57:05 +01:00
Hieu Hoang
0b23a0e327 rollback excluding translation options that have incompatible alignments for placeholders. This should be exclude at the training step 2013-07-26 19:39:10 +01:00
Hieu Hoang
9e8402dedd add placeholder support to extract 2013-07-26 15:46:15 +01:00
Hieu Hoang
e3917f911b add placeholder support to extract 2013-07-26 15:44:29 +01:00
Hieu Hoang
89058b7935 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-07-26 15:25:53 +01:00
Hieu Hoang
6be88d3f44 update filtering script to correct binarize pb models with CreateOnDiskPt 2013-07-26 15:12:15 +01:00
Hieu Hoang
efd9789577 update filtering script to correct binarize pb models with CreateOnDiskPt 2013-07-26 15:06:07 +01:00
Hieu Hoang
2ba7a372e8 add placeholder support to extract 2013-07-26 14:12:27 +01:00
Hieu Hoang
d1700435e0 eclipse file for extract 2013-07-26 14:00:19 +01:00
Hieu Hoang
4fde5f7ea2 eclipse file for extract-rules 2013-07-26 12:27:55 +01:00
Hieu Hoang
9451f5df98 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:57:21 +01:00
Hieu Hoang
38e312f44c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:55:16 +01:00
Barry Haddow
29aa9ea153 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:56:44 +01:00
Barry Haddow
c127c58e9b fix to single thread build 2013-07-25 15:56:20 +01:00
Hieu Hoang
a3e3289b08 In corpus mode, replace number with number symbol 2013-07-25 15:54:47 +01:00
Hieu Hoang
2aef439d8a Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:26:38 +01:00
Barry Haddow
7081f06413 Fixes to the shared build 2013-07-25 15:24:34 +01:00
Hieu Hoang
76a9730ca8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-07-25 15:23:12 +01:00
Hieu Hoang
e2c2bc59f1 beautify 2013-07-25 15:23:05 +01:00
Hieu Hoang
60478e5693 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 15:16:22 +01:00
Hieu Hoang
78381d0213 @NUM@ --> @num@. In case using recaser 2013-07-25 15:16:15 +01:00
Phil Williams
f0b603e6b5 extract-ghkm: write glue grammars for all sentence offsets
extract-parallel now merges separate glue grammars, so remove
previous workaround.
2013-07-25 13:53:32 +01:00
Hieu Hoang
4637f03278 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-07-25 12:59:42 +01:00