Commit Graph

42 Commits

Author SHA1 Message Date
Hieu Hoang
05ead45e71 beautify 2015-01-14 11:07:42 +00:00
Rico Sennrich
71756cca40 make config parameters more consistent with training / other LMs
(target_ngrams=4 source_ngrams=9 is now order=5 source_window=4)
2014-12-17 17:37:38 +00:00
Rico Sennrich
de7237c9de null padding 2014-12-15 16:44:33 +00:00
Rico Sennrich
6748f4106f compatibility with NPLM 0.3 (breaks earlier versions of NPLM) 2014-11-17 18:08:42 +00:00
XapaJIaMnu
2028b86642 BilingualNPLM requries specific source and target vocabulary lists 2014-11-13 16:14:17 +00:00
Rico Sennrich
9b161dc888 floor score of bilingualNPLM 2014-11-13 16:14:16 +00:00
XapaJIaMnu
18a6d12cb0 Rework lookup and greatly speedup decoding (2x+) 2014-11-13 16:14:16 +00:00
XapaJIaMnu
8e4ff790a7 Add null word support for hiero. 2014-11-13 16:14:16 +00:00
Paul Baltescu
248aa4bf8a Convert moses words to oxlm word ids. 2014-11-13 16:10:40 +00:00
Paul Baltescu
90ebf13789 Set BilingualLM parameters nicely. 2014-11-13 16:08:10 +00:00
Paul Baltescu
7588c4b8e3 Skeleton for source conditioned OxLM feature. 2014-11-13 16:08:10 +00:00
Paul Baltescu
4811701277 Fix broken include. 2014-11-13 15:51:48 +00:00
Paul Baltescu
5f87cf94d8 Move BilingualLM under LM. 2014-11-13 15:51:48 +00:00
XapaJIaMnu
a1a10a9209 Remove unused variable that likely causes crashes 2014-11-13 15:51:48 +00:00
XapaJIaMnu
97b7c766e4 fix vectors not being cleared 2014-11-13 15:51:47 +00:00
XapaJIaMnu
5d1584a3d8 Make it possible to have backend specific parameters. 2014-11-13 15:51:47 +00:00
XapaJIaMnu
0271b451b7 Some file renaming and fixes 2014-11-13 15:51:47 +00:00
XapaJIaMnu
af8ee9da43 Abstract BilingualLM. Working 2014-11-13 15:51:47 +00:00
XapaJIaMnu
bceff44fcb Abstract BilingualLM to Binlm_NPLM. Doesn't compile 2014-11-13 15:51:47 +00:00
XapaJIaMnu
46d8987635 Start abstracting NPLM from BilingualLM 2014-11-13 15:51:47 +00:00
XapaJIaMnu
e449df548a Fix a bunch of off by one and silly errors 2014-11-13 15:51:47 +00:00
XapaJIaMnu
38197698e0 Fix silly mistake in getTargetPhraseChart 2014-11-13 15:51:47 +00:00
XapaJIaMnu
ea03722aaa Fix a stupid mistake in TargetWords 2014-11-13 15:51:47 +00:00
XapaJIaMnu
7e26228fd7 Add support for moses_chart. Cleaning up needed. 2014-11-13 15:51:47 +00:00
Hieu Hoang
f76e1e8a03 compiles on gcc 4.6.3 2014-11-13 15:51:47 +00:00
XapaJIaMnu
62ec653df8 More work, source_ngrams missing 2014-11-13 15:51:47 +00:00
XapaJIaMnu
2979a617a9 int -> size_t 2014-11-13 15:51:47 +00:00
XapaJIaMnu
6e148defba Rename variable to better represent what it means. Start syntactic decoding 2014-11-13 15:51:47 +00:00
XapaJIaMnu
ea01ede796 Support for POS backoff in factored models. Spaghetti code needs refactoring 2014-11-13 15:51:46 +00:00
XapaJIaMnu
caf797a6a4 GetNeuralLMId requries word instead of factor 2014-11-13 15:51:46 +00:00
XapaJIaMnu
b5e5e12c9f Make some parameters of neuralLM optional 2014-11-13 15:51:46 +00:00
XapaJIaMnu
59ab036eb5 Get state, correct 2014-11-13 15:51:46 +00:00
XapaJIaMnu
4309903d6e State, almost correct or correct 2014-11-13 15:51:46 +00:00
XapaJIaMnu
c225fb27d1 Fix small indexing error 2014-11-13 15:51:46 +00:00
XapaJIaMnu
19a11b854d Fast version. Needs some cleanup, but works 2014-11-13 15:51:46 +00:00
XapaJIaMnu
1d1972330a State doesn't require whole target phrase 2014-11-13 15:51:46 +00:00
XapaJIaMnu
27ac2e49c7 Full lookup cache 2014-11-13 15:51:46 +00:00
XapaJIaMnu
e333bef6f4 Caching working 2014-11-13 15:51:46 +00:00
XapaJIaMnu
d9177cf75a Matching scores! And bugfixing 2014-11-13 15:51:46 +00:00
XapaJIaMnu
563f08c1d7 More bugfixes. Still different result from slow and fast 2014-11-13 15:51:46 +00:00
XapaJIaMnu
15a98ceadb A bunch of bugfixes and initial fast version. Still something wrong 2014-11-13 15:51:46 +00:00
Hieu Hoang
41b207e623 fix Jamfile 2014-11-13 15:51:46 +00:00