Commit Graph

12994 Commits

Author SHA1 Message Date
Ulrich Germann
6a70eed481 Bug fix in a sanity check in PrefixTree.h 2014-11-21 23:58:17 +00:00
Phil Williams
ef1262a17f extract-ghkm: change STSG output format. 2014-11-21 15:46:12 +00:00
Hieu Hoang
573f030332 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-21 13:55:24 +00:00
Hieu Hoang
c0be182bfa makemteval and small change to tokenizer. /Tom Hoar and Tomas Fulajtar 2014-11-21 13:55:13 +00:00
Phil Williams
c46fb10ec7 extract-ghkm: add --STSG option 2014-11-21 11:30:29 +00:00
Ulrich Germann
7aa4d5d8d5 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses-cmd/simulate-pe.cc
2014-11-20 17:55:51 +00:00
Hieu Hoang
2711410712 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-20 17:38:17 +00:00
Hieu Hoang
646874d77b simulated post editing 2014-11-20 17:38:02 +00:00
Hieu Hoang
9e5be78a7d simulated post editing 2014-11-20 17:28:50 +00:00
Hieu Hoang
c87db0c141 Parameter error 2014-11-20 17:05:08 +00:00
XapaJIaMnu
52c520c042 Resolve merge conflicts 2014-11-20 15:50:32 +00:00
Hieu Hoang
c346a4b198 Add rt library 2014-11-20 15:02:05 +00:00
Hieu Hoang
9c4eb7f249 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-20 12:45:22 +00:00
Hieu Hoang
8137aeae43 Small changes to Parameters and StaticData 2014-11-20 11:21:50 +00:00
Marcin Junczys-Dowmunt
6a52bfc199 Added -lpthread -lrt 2014-11-19 16:57:33 +01:00
Nicola Bertoldi
46596ed49a Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-11-18 15:16:16 +01:00
Nicola Bertoldi
92c2d3e2a4 added back-off combination technique 2014-11-18 15:16:05 +01:00
Hieu Hoang
070afadbcd eclipse 2014-11-17 22:40:36 +00:00
Rico Sennrich
6748f4106f compatibility with NPLM 0.3 (breaks earlier versions of NPLM) 2014-11-17 18:08:42 +00:00
Hieu Hoang
b1902cac4f cygwin compile 2014-11-17 17:44:46 +00:00
Rico Sennrich
4a94a41310 compatibility with NPLM 0.3 (fork on https://github.com/rsennrich/nplm)
breaks compatibility with older versions of NPLM, and older models.
2014-11-17 15:12:18 +00:00
Ulrich Germann
dbcad69f1d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-11-16 16:33:21 +00:00
Ulrich Germann
e9f192e65f Fixed after changes to the Moses code structure. 2014-11-16 16:32:41 +00:00
Ulrich Germann
bda7ace530 Minor changes due to changes in the Moses API. Removed from list of standard programs to be compiled and installed. May need some work to get it working again. 2014-11-16 16:31:12 +00:00
Ulrich Germann
f8f96f146e Removed sim-pe from the list of programs to be compiled and installed. Use simulate-pe from moses-cmd instead. 2014-11-16 16:29:00 +00:00
Marcin Junczys-Dowmunt
7388b19188 Update IOWrapper.cpp
Adding back std::endl in void IOWrapper::OutputAlignment(ostream &out, const vector<const Hypothesis *> &edges), removing it breaks -alignment-output-file
2014-11-16 14:17:28 +01:00
Hieu Hoang
005d331c16 Merge pull request #77 from pguyot/master
Fix incorrect integer concatenation in error messages
2014-11-16 08:08:41 +00:00
Hieu Hoang
e27f6b0120 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-15 14:32:49 +00:00
Hieu Hoang
67ad197d5a take out PYTHONIOENCODING=utf-8. Rely on Rico's python changes 2014-11-15 14:32:31 +00:00
XapaJIaMnu
a343837095 Add option to choose activation function during nplm training 2014-11-15 11:54:47 +00:00
Rico Sennrich
b0b5eef0c6 fix metric interpolation with mert 2014-11-14 14:35:32 +00:00
Hieu Hoang
acd3ac964a set PYTHONIOENCODING=utf-8 before running merge_alignment.py 2014-11-14 14:34:31 +00:00
Paul Baltescu
a8fa86d9a8 Update .gitignore. 2014-11-14 14:28:33 +00:00
Hieu Hoang
1c27e05a06 softlink for moses_chart 2014-11-14 13:56:56 +00:00
Paul Baltescu
35401f7dd3 Merge branch 'bilingual-lm' of github.com:moses-smt/mosesdecoder into bilingual-lm 2014-11-14 12:39:02 +00:00
Paul Baltescu
fefd2b0ada Fix merge errors. 2014-11-13 16:52:24 +00:00
XapaJIaMnu
2028b86642 BilingualNPLM requries specific source and target vocabulary lists 2014-11-13 16:14:17 +00:00
XapaJIaMnu
d5567b6cfb Training: Do the preparation step ourselves. No validation support yet. No decoder support yet. 2014-11-13 16:14:17 +00:00
Rico Sennrich
9b161dc888 floor score of bilingualNPLM 2014-11-13 16:14:16 +00:00
XapaJIaMnu
b254fcea99 moses/LM/BilingualLM.cpp 2014-11-13 16:14:16 +00:00
Rico Sennrich
8fd3be9e4e add EOS token </s> to each sentence 2014-11-13 16:14:16 +00:00
Rico Sennrich
f26fc251d5 sort vocab by frequency 2014-11-13 16:14:16 +00:00
XapaJIaMnu
bb70f60f67 grrr 2014-11-13 16:14:16 +00:00
XapaJIaMnu
e330ab35d5 Short option must be only one letter 2014-11-13 16:14:16 +00:00
XapaJIaMnu
a74105ea7d Fix a wrong condition 2014-11-13 16:14:16 +00:00
XapaJIaMnu
e54c171850 Make it optional to prepare the validation set 2014-11-13 16:14:16 +00:00
XapaJIaMnu
a300824bd1 Add optional validation during training 2014-11-13 16:14:16 +00:00
XapaJIaMnu
f6c64adb92 Remove unnecessary const gimmicks 2014-11-13 16:14:16 +00:00
XapaJIaMnu
18a6d12cb0 Rework lookup and greatly speedup decoding (2x+) 2014-11-13 16:14:16 +00:00
XapaJIaMnu
cf3fe60cf6 Backoff to null token in hiero 2014-11-13 16:14:16 +00:00