moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 14:32:38 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,030 Commits 136 Branches 26 Tags 147 MiB
08c57bce87
Commit Graph

13030 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Marcin Junczys-Dowmunt
6a52bfc199 Added -lpthread -lrt 2014-11-19 16:57:33 +01:00
Nicola Bertoldi
46596ed49a Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-11-18 15:16:16 +01:00
Nicola Bertoldi
92c2d3e2a4 added back-off combination technique 2014-11-18 15:16:05 +01:00
Hieu Hoang
070afadbcd eclipse 2014-11-17 22:40:36 +00:00
Rico Sennrich
6748f4106f compatibility with NPLM 0.3 (breaks earlier versions of NPLM) 2014-11-17 18:08:42 +00:00
Hieu Hoang
b1902cac4f cygwin compile 2014-11-17 17:44:46 +00:00
Rico Sennrich
4a94a41310 compatibility with NPLM 0.3 (fork on https://github.com/rsennrich/nplm) 
breaks compatibility with older versions of NPLM, and older models.
 2014-11-17 15:12:18 +00:00
Ulrich Germann
dbcad69f1d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-11-16 16:33:21 +00:00
Ulrich Germann
e9f192e65f Fixed after changes to the Moses code structure. 2014-11-16 16:32:41 +00:00
Ulrich Germann
bda7ace530 Minor changes due to changes in the Moses API. Removed from list of standard programs to be compiled and installed. May need some work to get it working again. 2014-11-16 16:31:12 +00:00
Ulrich Germann
f8f96f146e Removed sim-pe from the list of programs to be compiled and installed. Use simulate-pe from moses-cmd instead. 2014-11-16 16:29:00 +00:00
Marcin Junczys-Dowmunt
7388b19188 Update IOWrapper.cpp 
Adding back std::endl in void IOWrapper::OutputAlignment(ostream &out, const vector<const Hypothesis *> &edges), removing it breaks -alignment-output-file
 2014-11-16 14:17:28 +01:00
Hieu Hoang
005d331c16 Merge pull request #77 from pguyot/master 
Fix incorrect integer concatenation in error messages
 2014-11-16 08:08:41 +00:00
Hieu Hoang
e27f6b0120 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-15 14:32:49 +00:00
Hieu Hoang
67ad197d5a take out PYTHONIOENCODING=utf-8. Rely on Rico's python changes 2014-11-15 14:32:31 +00:00
XapaJIaMnu
a343837095 Add option to choose activation function during nplm training 2014-11-15 11:54:47 +00:00
Rico Sennrich
b0b5eef0c6 fix metric interpolation with mert 2014-11-14 14:35:32 +00:00
Hieu Hoang
acd3ac964a set PYTHONIOENCODING=utf-8 before running merge_alignment.py 2014-11-14 14:34:31 +00:00
Paul Baltescu
a8fa86d9a8 Update .gitignore. 2014-11-14 14:28:33 +00:00
Hieu Hoang
1c27e05a06 softlink for moses_chart 2014-11-14 13:56:56 +00:00
Paul Baltescu
35401f7dd3 Merge branch 'bilingual-lm' of github.com:moses-smt/mosesdecoder into bilingual-lm 2014-11-14 12:39:02 +00:00
Paul Baltescu
fefd2b0ada Fix merge errors. 2014-11-13 16:52:24 +00:00
XapaJIaMnu
2028b86642 BilingualNPLM requries specific source and target vocabulary lists 2014-11-13 16:14:17 +00:00
XapaJIaMnu
d5567b6cfb Training: Do the preparation step ourselves. No validation support yet. No decoder support yet. 2014-11-13 16:14:17 +00:00
Rico Sennrich
9b161dc888 floor score of bilingualNPLM 2014-11-13 16:14:16 +00:00
XapaJIaMnu
b254fcea99 moses/LM/BilingualLM.cpp 2014-11-13 16:14:16 +00:00
Rico Sennrich
8fd3be9e4e add EOS token </s> to each sentence 2014-11-13 16:14:16 +00:00
Rico Sennrich
f26fc251d5 sort vocab by frequency 2014-11-13 16:14:16 +00:00
XapaJIaMnu
bb70f60f67 grrr 2014-11-13 16:14:16 +00:00
XapaJIaMnu
e330ab35d5 Short option must be only one letter 2014-11-13 16:14:16 +00:00
XapaJIaMnu
a74105ea7d Fix a wrong condition 2014-11-13 16:14:16 +00:00
XapaJIaMnu
e54c171850 Make it optional to prepare the validation set 2014-11-13 16:14:16 +00:00
XapaJIaMnu
a300824bd1 Add optional validation during training 2014-11-13 16:14:16 +00:00
XapaJIaMnu
f6c64adb92 Remove unnecessary const gimmicks 2014-11-13 16:14:16 +00:00
XapaJIaMnu
18a6d12cb0 Rework lookup and greatly speedup decoding (2x+) 2014-11-13 16:14:16 +00:00
XapaJIaMnu
cf3fe60cf6 Backoff to null token in hiero 2014-11-13 16:14:16 +00:00
XapaJIaMnu
06fa9b5916 Add option to build with Og for newer versions of gcc 2014-11-13 16:14:16 +00:00
XapaJIaMnu
493f05eb97 Remove old unused code from BilingualLM 2014-11-13 16:14:16 +00:00
Paul Baltescu
211878c9d3 Make OxLM extensions compile. 2014-11-13 16:14:16 +00:00
XapaJIaMnu
8e4ff790a7 Add null word support for hiero. 2014-11-13 16:14:16 +00:00
Paul Baltescu
0578a31799 Flag for setting OxLM models to unnormalized. 2014-11-13 16:14:16 +00:00
XapaJIaMnu
0451142ece Add null token normalization for models to be used with the chart decoder. 2014-11-13 16:13:38 +00:00
XapaJIaMnu
aae894fe6b Add null token in vocabulary during construction 2014-11-13 16:13:38 +00:00
XapaJIaMnu
b4f51c05d1 Add option to reduce the ngrams from already prepared .ngrams file to train a model with smaller number of ngrams 2014-11-13 16:13:38 +00:00
XapaJIaMnu
5851a2c2bb Prevent realocation of vectors 2014-11-13 16:13:38 +00:00
Paul Baltescu
2705a47876 Fix OxLM. 2014-11-13 16:13:38 +00:00
XapaJIaMnu
02c375ef78 Refactor the BilingualLM for chart to make it faster. Untested 2014-11-13 16:13:04 +00:00
XapaJIaMnu
7858f74e9e Rename BilingualLM_NPLM so that it is not confused with a sparse feature 2014-11-13 16:13:04 +00:00
Paul Baltescu
61826cee8a Rename OxLM features. 2014-11-13 16:13:04 +00:00
Paul Baltescu
32c169c25f Optional back-off to POS tags in OxLM. 2014-11-13 16:12:19 +00:00