Commit Graph

13030 Commits

Author SHA1 Message Date
Paul Baltescu
1d28f5186b Rename OxLM features. 2014-09-30 15:57:20 +01:00
Rico Sennrich
f63807f957 more robust regex 2014-09-30 15:43:38 +01:00
Hieu Hoang
f205f5e99c fix server compile error 2014-09-30 14:49:36 +01:00
Hieu Hoang
33ed15ef19 move misc common functions into moses/ 2014-09-30 14:22:38 +01:00
Ulrich Germann
a01b6d6257 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-09-30 13:24:34 +01:00
Hieu Hoang
c20af584e7 move TranslationTask into moses/ 2014-09-30 12:59:31 +01:00
Hieu Hoang
ebd2e72494 separate out class TranslationTask into it's on file 2014-09-30 12:47:28 +01:00
Hieu Hoang
c40faed0d6 separate out class TranslationTask into it's on file 2014-09-30 12:25:36 +01:00
Hieu Hoang
85261aa190 Merge ../mosesdecoder into merge-cmd 2014-09-30 10:32:29 +01:00
Hieu Hoang
87afd853e5 warn against using SRILM 1.7.1 2014-09-30 10:06:52 +01:00
Hieu Hoang
26c3683a6c move IOWrapper into moses/ 2014-09-29 17:59:14 +01:00
Hieu Hoang
55db902f5f move IOWrapper into moses/ 2014-09-29 17:58:20 +01:00
Hieu Hoang
d60571341d move LatticeMBR into moses/ 2014-09-29 17:34:11 +01:00
Paul Baltescu
26ef9fddaa Optional back-off to POS tags in OxLM. 2014-09-29 17:25:26 +01:00
Hieu Hoang
08d6f77cea move TranslationAnalysis for both moses-cmd and moses-char-cmd into moses/ 2014-09-29 17:16:11 +01:00
Paul Baltescu
c5ad6f9839 Correctly map the source unknown token. 2014-09-29 01:05:43 +01:00
Paul Baltescu
edde0324dd Fix Bilingual OxLM context word order. 2014-09-28 16:53:41 +01:00
Paul Baltescu
c8ac4532ff Make query cache sentence specific. 2014-09-27 15:28:42 +01:00
Paul Baltescu
822aaa7dae Convert moses words to oxlm word ids. 2014-09-26 23:20:26 +01:00
Paul Baltescu
5c3b3f6057 Clean up OxLMMapper. 2014-09-26 16:46:04 +01:00
Paul Baltescu
3babd6dbb9 Set BilingualLM parameters nicely. 2014-09-26 16:25:48 +01:00
Paul Baltescu
a36ae66345 Skeleton for source conditioned OxLM feature. 2014-09-26 15:50:25 +01:00
Paul Baltescu
92f03662ec Rename LBLLM -> OxLM. 2014-09-26 15:18:14 +01:00
Paul Baltescu
30c3616a83 Fix compilation errors introduced by new oxlm changes. 2014-09-26 14:43:16 +01:00
Paul Baltescu
b6fa358427 Fix broken include. 2014-09-26 13:25:06 +01:00
Paul Baltescu
220c95ed9f Fix bugs in BilingualLM for chart based decoding. 2014-09-26 12:32:18 +01:00
Paul Baltescu
d162c47587 Fix a few bugs in BilingualLM for phrase based decoding. 2014-09-26 12:32:18 +01:00
Paul Baltescu
46b388885a Move BilingualLM under LM. 2014-09-26 12:32:17 +01:00
XapaJIaMnu
844a7d99af Make sure we always have unk in the vocabulary, otherwise we get off-by-one indexes during decoding 2014-09-26 12:24:13 +01:00
XapaJIaMnu
5ec566cba2 Forgot to close a file... 2014-09-25 18:38:34 +01:00
XapaJIaMnu
d2c587aeff Fix small oversights 2014-09-25 18:09:59 +01:00
XapaJIaMnu
6379a1da17 Extend train_nplm with various options 2014-09-25 17:43:54 +01:00
Rico Sennrich
84ad576750 explicitly set BLEU as default scorer (for return-best-dev)
(evaluator doesn't accept --scconfig without --sctype)
2014-09-24 14:47:58 +01:00
Hieu Hoang
610090c2ed don't run truecase trainer unless it's asked for 2014-09-23 21:50:53 +01:00
XapaJIaMnu
238e79e045 Remove unused variable that likely causes crashes 2014-09-22 13:43:55 +01:00
Hieu Hoang
58a49fd2df eclipse 2014-09-22 11:23:33 +01:00
Hieu Hoang
c8d6ff05bd don't ever link to libboost*-mt 2014-09-22 10:56:14 +01:00
Rico Sennrich
59cd4be2c9 don't use optimizer-specific options in extractor/evaluator 2014-09-22 10:49:20 +01:00
Rico Sennrich
d39cbca0b9 (optionally) use n-best file for evaluator/return-best-dev
this adds support for metrics that rely on alignment / trees
2014-09-22 10:49:20 +01:00
Rico Sennrich
3d00e5dc8c basic support for more metrics with kbmira
metrics need getReferenceLength (for background smoothing) to work with kbmira
2014-09-22 10:49:20 +01:00
Rico Sennrich
6810b225cc calculateScore with float (for smoothing support) 2014-09-22 10:49:20 +01:00
Rico Sennrich
f40bb2c53c HWCM for MERT 2014-09-22 10:49:20 +01:00
Hieu Hoang
2c66ae5e34 eclipse 2014-09-22 10:18:08 +01:00
Philipp Koehn
ab90efe4af allow specification of default weights 2014-09-22 05:28:57 +01:00
Philipp Koehn
33fbbc5faa allow specification of default scores for lexicalized reordering model 2014-09-21 07:43:44 +01:00
Philipp Koehn
e9db2fe4aa Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2014-09-21 06:04:22 +01:00
Philipp Koehn
1ed54a6181 add tool for phrase lookup with biconcor 2014-09-21 06:03:51 +01:00
Philipp Koehn
3740c9f248 bug fix mmsapt training 2014-09-21 06:02:35 +01:00
Philipp Koehn
a8659d1399 support for specified weights 2014-09-21 06:01:16 +01:00
Philipp Koehn
acefdb0262 bug fix for final-step 2014-09-21 05:59:21 +01:00