Commit Graph

2897 Commits

Author SHA1 Message Date
Hieu Hoang
74aea53fd5 caching error for compact pt 2013-08-20 16:06:48 +01:00
Hieu Hoang
51ac2d6567 Merge branch 'hieu_opt_input' of ../hh 2013-08-16 17:05:04 +01:00
Hieu Hoang
4d2fea9b38 prevent segfault in OSM model when used in factored model with decomposed phrase-tables 2013-08-16 16:37:40 +01:00
Hieu Hoang
ae54494417 caching for Marcin's phrase table 2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc add method to reduce cache size 2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d caching target phrase for OnDisk pt 2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1 caching target phrase for OnDisk pt 2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef caching target phrase for OnDisk pt 2013-08-16 12:34:31 +01:00
Hieu Hoang
55920d5bca Merge ../mosesdecoder into hieu_opt_input 2013-08-16 12:11:13 +01:00
Hieu Hoang
8363f4afa9 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-08-16 12:10:36 +01:00
Hieu Hoang
a8c0c0ecde Merge branch 'master' of github.com:hieuhoang/mosesdecoder 2013-08-16 12:06:54 +01:00
Hieu Hoang
21657b6243 delete duplicate parameter 2013-08-16 12:02:48 +01:00
Hieu Hoang
55bd87d38c Merge pull request #43 from jgwinnup/master
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59 beautify 2013-08-15 21:14:04 +01:00
Hieu Hoang
49e36cebc2 minor renaming 2013-08-15 20:57:04 +01:00
Hieu Hoang
aa8b8cdc07 move caching code to PhraseDictionary. Available to all phrase tables 2013-08-15 20:50:22 +01:00
Hieu Hoang
841ce108a5 add phrase table caching 2013-08-15 20:20:44 +01:00
Jeremy Gwinnup
091bed03af Added option to output unknown words with prefix 'UNK' 2013-08-15 11:30:08 -04:00
phikoehn
c002a81c96 fixed logic errors 2013-08-15 13:36:56 +01:00
phikoehn
b368085609 xml constraint 2013-08-15 11:46:45 +01:00
Hieu Hoang
abfe02f154 refactor input score handling to use Evaluate(inputtype, inputpath). Not a placeholder factor anymore 2013-08-14 16:53:06 +01:00
Hieu Hoang
2b030339e0 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-08-14 12:38:26 +01:00
Hieu Hoang
8419a3af35 beautify 2013-08-14 12:37:22 +01:00
Hieu Hoang
bfdedf682b convert weight-p to PhrasePenalty. /Nicola Bertoldi 2013-08-14 12:36:40 +01:00
Hieu Hoang
896b751066 Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-08-13 21:33:31 +01:00
Hieu Hoang
073b60db35 implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 20:47:03 +01:00
Hieu Hoang
efc765ddff implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 20:36:32 +01:00
Hieu Hoang
c50cc18f36 use input path for unknown word processing in phrase-based 2013-08-13 20:01:13 +01:00
Hieu Hoang
563cdc527a use input path for unknown word processing in phrase-based 2013-08-13 19:44:52 +01:00
Hieu Hoang
dcf170a047 refactor bleu score feature function. Still segfaults when running mira 2013-08-13 16:41:35 +01:00
Hieu Hoang
3775e37ee5 refactor bleu score feature function. Still segfaults when running mira 2013-08-13 16:39:37 +01:00
Hieu Hoang
aa7eabf850 add parameter argument -feature-add for mira BLEU score feature 2013-08-13 15:34:03 +01:00
Hieu Hoang
0d60b7f2dd implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 12:16:55 +01:00
Hieu Hoang
f676100328 implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 12:12:58 +01:00
Hieu Hoang
af74ee1968 delete duplicate m_inputPathMatrix in TranslationOptionList 2013-08-13 11:44:58 +01:00
Hieu Hoang
4676bca90f minor renaming 2013-08-13 10:33:04 +01:00
Hieu Hoang
154ca336d6 separate out ChartTranslationOption into its own files 2013-08-12 19:01:06 +01:00
Hieu Hoang
9c2c862719 don't hold shared_ptr in RuleCubeItem. Hold only reference to it. Save some speed 2013-08-12 17:35:22 +01:00
Hieu Hoang
c07d8cb43f beautify 2013-08-12 10:35:03 +01:00
Hieu Hoang
2a240b59b2 delete debug messages 2013-08-12 10:34:38 +01:00
Hieu Hoang
46fce4029c create ChartTranslationOption class that store pointer to target phrase. Don't store target phrase itself. QUicker, but still not as quick as storing pointer to target phrase in hypo 2013-08-12 10:34:45 +01:00
Hieu Hoang
8756ad8ffd beautify 2013-08-09 18:17:18 +01:00
Hieu Hoang
a867063a3b convert to using shared pointers in ChartTranslationOptions 2013-08-09 18:16:31 +01:00
Hieu Hoang
4db9aa2973 convert to using shared pointers in ChartTranslationOptions 2013-08-09 15:20:45 +01:00
Hieu Hoang
f4d534ffd7 add InputPath objects of chart decoding. Start on lattice input for chart decoding 2013-08-09 10:27:46 +01:00
Hieu Hoang
59e7a179ca add InputPath objects of chart decoding. Start on lattice input for chart decoding 2013-08-08 21:29:22 +01:00
Hieu Hoang
15132a04aa comment 2013-08-08 17:58:38 +01:00
Hieu Hoang
9341f28d75 Evaluate(InputType) --> Evaluate(InputType, Phrase source) 2013-08-08 17:35:42 +01:00
Hieu Hoang
b044f31012 consistently set source phrase in translation options as soon as the trans opt is created 2013-08-08 17:10:56 +01:00
Hieu Hoang
4b28daeed2 consistently set source phrase in translation options as soon as the trans opt is created 2013-08-08 15:58:01 +01:00