Commit Graph

11407 Commits

Author SHA1 Message Date
Hieu Hoang
a5d0296699 make transliteration phrase table thread safe 2013-12-06 16:25:17 +00:00
Hieu Hoang
09d50f87b1 move word penalty feature out of StaticData 2013-12-06 15:57:49 +00:00
Hieu Hoang
f77fd7fb45 set parameters for fuzzy match. Not tested 2013-12-06 14:23:22 +00:00
Hieu Hoang
78eba93a6b minor change in argument key for consistency 2013-12-06 13:09:34 +00:00
Hieu Hoang
0e156afd5b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-06 13:07:40 +00:00
Hieu Hoang
fc8f8ba657 minor change in argument key for consistency 2013-12-06 13:07:33 +00:00
Rico Sennrich
96ca814b86 special handling of partial rules that can only have terminal symbol next;
we only need to search once for matching terminals.

speed: 336s -> 309s
VmPeak: 2914132kB -> 2783064kB
RSSMax: 2766976kB -> 2699148kB
2013-12-06 12:54:58 +00:00
Hieu Hoang
7d497abf41 minor verbose in consolidate-main.cpp 2013-12-06 11:46:19 +00:00
Hieu Hoang
3ab1a9996b comment 2013-12-06 11:32:53 +00:00
Hieu Hoang
c0a40ecbb8 finesse instruction for building Boost 2013-12-05 16:24:54 +00:00
Hieu Hoang
cc9ecdff0a rename TransliterationPhraseDictionary to PhraseDictionaryTransliteration 2013-12-05 13:13:01 +00:00
Hieu Hoang
b33cf30bc1 transliteration pt obery backoff argument. Probably not threadable yet 2013-12-05 13:06:35 +00:00
Hieu Hoang
19aa8c1056 changes to moses-parallel.pl to make it work. /Thomas Meyer 2013-12-05 12:23:40 +00:00
Hieu Hoang
d3301fa1a3 move backoff parameter into decode graph class 2013-12-05 12:19:55 +00:00
Hieu Hoang
0dac035a12 arguments for transliteration phrase-table 2013-12-04 19:16:37 +00:00
Hieu Hoang
51f5bbea5d transliteration phrase-table now working. Just need to not hardcode some variables and make it obey -decoding-graph-backoff 2013-12-04 18:47:33 +00:00
Hieu Hoang
3a98885e56 :Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-04 11:49:43 +00:00
Hieu Hoang
cfc348a413 minor change from stdout to stderr 2013-12-04 11:49:24 +00:00
Ales Tamchyna
64b629803d fixed a bug in CoveredRerefenceFeature 2013-12-04 10:21:01 +01:00
Jun-ya NORIMATSU
09123008d9 Merge pull request #3 from moses-smt/master
latest
2013-12-04 01:13:58 -08:00
Ales Tamchyna
81ad92cc3f minor 2013-12-03 17:29:50 +01:00
Ales Tamchyna
fea32c7182 debugged CoveredReferenceFeature 2013-12-03 17:25:42 +01:00
Ales Tamchyna
8c0b5ffa6f early evaluation of CoveredReferenceFeature 2013-12-03 17:03:41 +01:00
Ales Tamchyna
effd98f577 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-03 17:03:09 +01:00
Hieu Hoang
1d56e4c0b1 minor verbose message 2013-12-03 15:56:11 +00:00
Ales Tamchyna
cd63f30f15 modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
Ales Tamchyna
fec97d2073 minor, added a check in CoveredReferenceFeature 2013-12-03 14:30:19 +01:00
Hieu Hoang
dd78bf0951 add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:31:15 +00:00
Hieu Hoang
04cbbc48cf add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:29:13 +00:00
Nadir Durrani
ec4fe7a465 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-12-02 14:50:29 +00:00
Nadir Durrani
c527f0db8d Transliteration Scripts 2013-12-02 14:49:21 +00:00
phikoehn
6824d84491 bug fix with interaction of alternate weights and xml markup 2013-11-30 02:00:34 +00:00
phikoehn
dab6a301fa make reference-from-sgm.perl more robust 2013-11-30 02:00:04 +00:00
Ales Tamchyna
86a0dc337a adding CoveredReferenceFeature 2013-11-29 09:27:43 +01:00
Hieu Hoang
cedc815c88 return default even if compiling with non-gcc 2013-11-25 16:38:19 +00:00
Hieu Hoang
905ab6de82 stop warning about incomplete data type 2013-11-25 16:24:51 +00:00
Hieu Hoang
6fcbb33940 eclipse 2013-11-24 15:40:49 +00:00
Hieu Hoang
f13d0c8244 UTIL_THROW_IF -> UTIL_THROW_IF2 2013-11-22 20:27:46 +00:00
Hieu Hoang
028edf8550 add -feature-name-overwrite. Specifically to replace PhraseDictionaryMemory with PhraseDictionaryScope3 for scope-3 decoding 2013-11-22 19:13:09 +00:00
Hieu Hoang
a57c9d6fe8 delete -parsing-algorithm. Scope-3 parsing depends on the phrase-table implementation used, not this argument 2013-11-22 17:35:22 +00:00
Hieu Hoang
31632301f9 Scope-3 parsing working again 2013-11-22 16:26:21 +00:00
Hieu Hoang
c4dfc60f95 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-11-22 15:26:23 +00:00
Hieu Hoang
5c6d88a463 add new phrase table for Scope-3 parsing. Doesn't quite work... 2013-11-22 15:26:14 +00:00
Hieu Hoang
193ee8aca6 minor compile error on Mac OSX 2013-11-21 19:19:34 +00:00
Hieu Hoang
0a8390981e delete includes for util/check.hh 2013-11-21 18:58:28 +00:00
Hieu Hoang
43dc333cd7 replace CHECK with UTIL_THROW_IF in Moses 2013-11-21 18:26:58 +00:00
Hieu Hoang
819c006253 replace CHECK with UTIL_THROW_IF in Moses 2013-11-21 17:51:01 +00:00
Hieu Hoang
3c0eaac9a3 replace CHECK with UTIL_THROW_IF in Moses 2013-11-21 14:55:41 +00:00
Hieu Hoang
8381f0c95c replace CHECK with UTIL_THROW_IF in Moses 2013-11-21 13:38:30 +00:00
Hieu Hoang
d1265d6bf0 call decoder with new -no-cache arg 2013-11-21 12:01:25 +00:00