Commit Graph

10830 Commits

Author SHA1 Message Date
Hieu Hoang
3ad3cd9004 delete ChartBasedFeatureContext 2013-08-23 14:39:42 +01:00
Hieu Hoang
1d653c87aa delete PhraseBasedFeatureContext 2013-08-23 14:25:25 +01:00
Hieu Hoang
4dfb625536 beautify 2013-08-23 13:53:30 +01:00
Hieu Hoang
0613d98beb delete PhraseBasedFeatureContext 2013-08-23 13:38:31 +01:00
Kenneth Heafield
9186ae2d82 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-22 10:21:37 +01:00
Kenneth Heafield
c4dc57f8a3 swap 2013-08-22 10:16:24 +01:00
Kenneth Heafield
6b5c1a09e4 unwind library, cleanup 2013-08-22 10:16:12 +01:00
Hieu Hoang
5accd5f2e5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-22 09:24:58 +01:00
Hieu Hoang
21c91dede2 delete GetWordPenaltyProducer(). Need non-const version only for mira 2013-08-22 09:24:46 +01:00
Hieu Hoang
734c546c86 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-21 15:58:27 +01:00
Hieu Hoang
fcf426a098 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 15:58:17 +01:00
Kenneth Heafield
37c22cd4da Also use unwind for for tcmalloc 2013-08-21 14:29:00 +01:00
Kenneth Heafield
74dcf5792d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-08-21 10:17:06 +01:00
Kenneth Heafield
b1d7340b78 Add --full-tcmalloc to link against the non-minimal tcmalloc library 2013-08-21 10:16:33 +01:00
Hieu Hoang
9e60195995 patch segfault for target phrase caching. Only occurs when multithreading. 2013-08-21 10:15:29 +01:00
Hieu Hoang
74aea53fd5 caching error for compact pt 2013-08-20 16:06:48 +01:00
Hieu Hoang
c60608a760 Merge pull request #44 from jgwinnup/master
Fixed bug in tokenizer.perl where comma separated lists of single characters aren't handled correctly, updated Russian NBP list
2013-08-17 05:09:19 -07:00
Jeremy Gwinnup
a5fb4d1550 Fixed bug in tokenizer.perl where comma separated lists of single
characters aren't handled correctly

input> A,B,C,D,E,F

yielded> A, B,C , D,E , F

now yields> A, B, C, D, E, F

Updated Russian nonbreaking prefixes list with capital letters
2013-08-16 14:39:50 -04:00
Hieu Hoang
51ac2d6567 Merge branch 'hieu_opt_input' of ../hh 2013-08-16 17:05:04 +01:00
Hieu Hoang
4d2fea9b38 prevent segfault in OSM model when used in factored model with decomposed phrase-tables 2013-08-16 16:37:40 +01:00
Hieu Hoang
ae54494417 caching for Marcin's phrase table 2013-08-16 15:33:58 +01:00
Hieu Hoang
41d9386dcc add method to reduce cache size 2013-08-16 15:05:36 +01:00
Hieu Hoang
3bfb0d7a5d caching target phrase for OnDisk pt 2013-08-16 13:47:39 +01:00
Hieu Hoang
077142a2a1 caching target phrase for OnDisk pt 2013-08-16 13:26:21 +01:00
Hieu Hoang
31360e70ef caching target phrase for OnDisk pt 2013-08-16 12:34:31 +01:00
Hieu Hoang
55920d5bca Merge ../mosesdecoder into hieu_opt_input 2013-08-16 12:11:13 +01:00
Hieu Hoang
8363f4afa9 Merge branch 'hieu_opt_input' of github.com:hieuhoang/mosesdecoder into hieu_opt_input 2013-08-16 12:10:36 +01:00
Hieu Hoang
a8c0c0ecde Merge branch 'master' of github.com:hieuhoang/mosesdecoder 2013-08-16 12:06:54 +01:00
Hieu Hoang
21657b6243 delete duplicate parameter 2013-08-16 12:02:48 +01:00
Hieu Hoang
55bd87d38c Merge pull request #43 from jgwinnup/master
Added option to output unknown words with prefix 'UNK'
2013-08-15 14:20:48 -07:00
Hieu Hoang
9f92642e59 beautify 2013-08-15 21:14:04 +01:00
Hieu Hoang
49e36cebc2 minor renaming 2013-08-15 20:57:04 +01:00
Hieu Hoang
aa8b8cdc07 move caching code to PhraseDictionary. Available to all phrase tables 2013-08-15 20:50:22 +01:00
Hieu Hoang
841ce108a5 add phrase table caching 2013-08-15 20:20:44 +01:00
Jeremy Gwinnup
091bed03af Added option to output unknown words with prefix 'UNK' 2013-08-15 11:30:08 -04:00
Hieu Hoang
5fa6e506b1 Jamroot error 2013-08-15 15:39:40 +01:00
phikoehn
c002a81c96 fixed logic errors 2013-08-15 13:36:56 +01:00
phikoehn
b368085609 xml constraint 2013-08-15 11:46:45 +01:00
Hieu Hoang
abfe02f154 refactor input score handling to use Evaluate(inputtype, inputpath). Not a placeholder factor anymore 2013-08-14 16:53:06 +01:00
Hieu Hoang
2b030339e0 Merge /home/hieu/workspace/github/mosesdecoder into hieu_opt_input 2013-08-14 12:38:26 +01:00
Hieu Hoang
8419a3af35 beautify 2013-08-14 12:37:22 +01:00
Hieu Hoang
bfdedf682b convert weight-p to PhrasePenalty. /Nicola Bertoldi 2013-08-14 12:36:40 +01:00
Hieu Hoang
896b751066 Merge /Users/hieuhoang/unison/workspace/github/mosesdecoder into hieu_opt_input 2013-08-13 21:33:31 +01:00
Hieu Hoang
073b60db35 implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 20:47:03 +01:00
Hieu Hoang
efc765ddff implement Evaluate(inputpath, input) for chart translation options. Plumbing for lattice input 2013-08-13 20:36:32 +01:00
Hieu Hoang
c50cc18f36 use input path for unknown word processing in phrase-based 2013-08-13 20:01:13 +01:00
Hieu Hoang
563cdc527a use input path for unknown word processing in phrase-based 2013-08-13 19:44:52 +01:00
Hieu Hoang
dcf170a047 refactor bleu score feature function. Still segfaults when running mira 2013-08-13 16:41:35 +01:00
Hieu Hoang
3775e37ee5 refactor bleu score feature function. Still segfaults when running mira 2013-08-13 16:39:37 +01:00
Hieu Hoang
aa7eabf850 add parameter argument -feature-add for mira BLEU score feature 2013-08-13 15:34:03 +01:00