Commit Graph

11275 Commits

Author SHA1 Message Date
Hieu Hoang
ff3c8c195a compare translation option dimension using pointers to translation option, rather than comparing the phrase. Comparinf the phrase is incorrect - need to compare LHS and possibly alignments too. Unnecessary 2013-12-13 17:23:39 +00:00
Hieu Hoang
3bd5583976 more debug functions 2013-12-13 15:47:26 +00:00
Hieu Hoang
95a41c44fa more debug functions 2013-12-12 01:20:12 +00:00
Hieu Hoang
06b0b6ae87 c++ acting like a dumbass untyped scripting language and silently cast variables. Hashing of some obscure object didn't work on old boost. Broke target syntax when linking against those old boost libraries 2013-12-12 01:13:23 +00:00
Hieu Hoang
7c237bf389 delete -#if defined(BOOST... Trying to find target syntax bug when using old boost 2013-12-11 21:45:30 +00:00
Hieu Hoang
bc9ce334d0 more debug functions 2013-12-11 20:03:30 +00:00
Hieu Hoang
fb356606e9 debug function for ChartTranslationOptionList and ChartTranslationOptions 2013-12-11 19:19:25 +00:00
Hieu Hoang
ebc6e59b17 consistent global variable g_mosesDebug 2013-12-11 19:04:42 +00:00
Ian Johnson
b2d074a191 Added missing Makefiles. 2013-12-11 17:23:08 +00:00
Ian Johnson
ce6e2b1953 Fixed mert phase 2013-12-11 17:22:00 +00:00
Ian Johnson
54c6bbdd9e Replaced the tokenizer with a PCL implementation. 2013-12-11 17:00:07 +00:00
phikoehn
8222a764bc Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2013-12-10 19:19:30 +00:00
phikoehn
34b73cd57e added scripts for threshold filtering phrase table 2013-12-10 19:19:12 +00:00
Hieu Hoang
295c07e884 bug in constrained decoding 2013-12-10 18:47:13 +00:00
Hieu Hoang
e64368e7e4 Forgot to call SetFeaturesToApply() for SkeletonPT and Transliteration phrase table 2013-12-10 12:42:05 +00:00
Jason Riesa
2b882b6e71 Updated Picaro to include missing sample alignment files. 2013-12-09 18:41:26 -08:00
Hieu Hoang
2ebb2cd5d4 added Picaro /Jason Riesa 2013-12-09 23:24:48 +00:00
Hieu Hoang
7bae70a2bc minor. More description of -feature-overwrite 2013-12-09 11:53:46 +00:00
Hieu Hoang
ba209202ef move all feature functions out of StaticData 2013-12-07 00:21:06 +00:00
Hieu Hoang
a5d0296699 make transliteration phrase table thread safe 2013-12-06 16:25:17 +00:00
Hieu Hoang
09d50f87b1 move word penalty feature out of StaticData 2013-12-06 15:57:49 +00:00
Hieu Hoang
f77fd7fb45 set parameters for fuzzy match. Not tested 2013-12-06 14:23:22 +00:00
Hieu Hoang
78eba93a6b minor change in argument key for consistency 2013-12-06 13:09:34 +00:00
Hieu Hoang
0e156afd5b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-06 13:07:40 +00:00
Hieu Hoang
fc8f8ba657 minor change in argument key for consistency 2013-12-06 13:07:33 +00:00
Rico Sennrich
96ca814b86 special handling of partial rules that can only have terminal symbol next;
we only need to search once for matching terminals.

speed: 336s -> 309s
VmPeak: 2914132kB -> 2783064kB
RSSMax: 2766976kB -> 2699148kB
2013-12-06 12:54:58 +00:00
Hieu Hoang
7d497abf41 minor verbose in consolidate-main.cpp 2013-12-06 11:46:19 +00:00
Hieu Hoang
3ab1a9996b comment 2013-12-06 11:32:53 +00:00
Hieu Hoang
c0a40ecbb8 finesse instruction for building Boost 2013-12-05 16:24:54 +00:00
Hieu Hoang
cc9ecdff0a rename TransliterationPhraseDictionary to PhraseDictionaryTransliteration 2013-12-05 13:13:01 +00:00
Hieu Hoang
b33cf30bc1 transliteration pt obery backoff argument. Probably not threadable yet 2013-12-05 13:06:35 +00:00
Hieu Hoang
19aa8c1056 changes to moses-parallel.pl to make it work. /Thomas Meyer 2013-12-05 12:23:40 +00:00
Hieu Hoang
d3301fa1a3 move backoff parameter into decode graph class 2013-12-05 12:19:55 +00:00
Hieu Hoang
0dac035a12 arguments for transliteration phrase-table 2013-12-04 19:16:37 +00:00
Hieu Hoang
51f5bbea5d transliteration phrase-table now working. Just need to not hardcode some variables and make it obey -decoding-graph-backoff 2013-12-04 18:47:33 +00:00
Hieu Hoang
3a98885e56 :Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-04 11:49:43 +00:00
Hieu Hoang
cfc348a413 minor change from stdout to stderr 2013-12-04 11:49:24 +00:00
Ales Tamchyna
64b629803d fixed a bug in CoveredRerefenceFeature 2013-12-04 10:21:01 +01:00
Ales Tamchyna
81ad92cc3f minor 2013-12-03 17:29:50 +01:00
Ales Tamchyna
fea32c7182 debugged CoveredReferenceFeature 2013-12-03 17:25:42 +01:00
Ales Tamchyna
8c0b5ffa6f early evaluation of CoveredReferenceFeature 2013-12-03 17:03:41 +01:00
Ales Tamchyna
effd98f577 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-12-03 17:03:09 +01:00
Hieu Hoang
1d56e4c0b1 minor verbose message 2013-12-03 15:56:11 +00:00
Ales Tamchyna
cd63f30f15 modified FF interface: Evaluate() with input has access to future-cost estimation 2013-12-03 16:50:41 +01:00
Ales Tamchyna
fec97d2073 minor, added a check in CoveredReferenceFeature 2013-12-03 14:30:19 +01:00
Hieu Hoang
dd78bf0951 add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:31:15 +00:00
Hieu Hoang
04cbbc48cf add phrase-table wrapper for Nadir's transliteration code 2013-12-02 15:29:13 +00:00
Nadir Durrani
ec4fe7a465 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-12-02 14:50:29 +00:00
Nadir Durrani
c527f0db8d Transliteration Scripts 2013-12-02 14:49:21 +00:00
phikoehn
6824d84491 bug fix with interaction of alternate weights and xml markup 2013-11-30 02:00:34 +00:00