Commit Graph

11862 Commits

Author SHA1 Message Date
Jun-ya NORIMATSU
cc71e0ee54 bugfix. 2014-06-05 19:26:27 +09:00
Jun-ya NORIMATSU
0659c31c05 Merge remote-tracking branch 'origin/master' 2014-06-05 14:24:44 +09:00
Jun-ya NORIMATSU
1180f5dd70 bug fix. 2014-06-05 14:24:10 +09:00
Ulrich Germann
5116f0072b Minor edits to ug_bitext.h. Added min_diverse to ug_bitext::job to ensure minimum number of translation alternatives before sampling stops. 2014-06-05 01:50:55 +01:00
Ulrich Germann
b92d599727 Bug fix in mmlex-lookup. 2014-06-05 01:48:11 +01:00
Ulrich Germann
2f109621bf Added configurable options and SetTableLimit to Mmsapt. 2014-06-05 01:47:29 +01:00
Ulrich Germann
a40fcbae02 Added utility lookup_mmsapt 2014-06-05 01:45:34 +01:00
Ulrich Germann
22ec93b85c Added operator [] to TargetPhraseCollection. 2014-06-05 01:44:11 +01:00
Ulrich Germann
c7a0520a18 Made moses shut up by changing unconditional 'cerr's to VERBOSE(1,...) 2014-06-05 01:43:26 +01:00
Ulrich Germann
004b8c9078 Changed Phrase.m_words from private to protected. 2014-06-05 01:41:50 +01:00
Ulrich Germann
3145bf3cc4 Commented out unused variable. 2014-06-05 01:40:51 +01:00
Ulrich Germann
0e98a08446 Commented out unused variable. 2014-06-05 01:40:27 +01:00
Ulrich Germann
5ae57f09d7 Commented out unused variable. 2014-06-05 01:39:44 +01:00
Ulrich Germann
ce853731ae Added mmsapt lookup utility. 2014-06-05 01:38:55 +01:00
Kenneth Heafield
6d9173ba72 KenLM f81d02792087a837ea17e6ce2b33f9b7aaecca68 should fix segfault with ArrayTrie 2014-06-04 16:03:39 -07:00
Kenneth Heafield
d82bd475a2 Nadir Durrani asked me to add this script 2014-06-04 11:27:36 -07:00
Hieu Hoang
b2de22fccb Merge pull request #65 from proycon/master
python-contrib was not up to date anymore with current PhraseDictionaryTree() constructor: fixed and reran cython (newer version) to generate cpp
2014-06-04 12:40:54 +01:00
Barry Haddow
ea37abbf45 lm query output has been modified 2014-06-03 22:13:25 +01:00
Barry Haddow
1a4b641421 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-03 22:13:17 +01:00
Ulrich Germann
8dee1725fb Removed Phrase penalty as a built-in feature function. 2014-06-03 21:36:04 +01:00
Ulrich Germann
729910883a Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-03 19:25:36 +01:00
Ulrich Germann
9c27dc08e9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
Conflicts:
	moses/FF/ConstrainedDecoding.cpp
2014-06-03 18:55:53 +01:00
Hieu Hoang
9f5a7b119f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-06-03 17:10:19 +01:00
Hieu Hoang
3ae671fc7c ||| separator after counts 2014-06-03 17:10:09 +01:00
Kenneth Heafield
346a8f41b0 Use boost::ref for Visual Studio / Mike Ladwig 2014-06-03 08:48:10 -07:00
Ulrich Germann
9cda39f802 Major bug fix in setting ug_bitext::jstats.my_cnt2. 2014-06-03 15:48:27 +01:00
Ulrich Germann
8c9a26a3be Added phrase feature function for log counts. 2014-06-03 15:45:29 +01:00
Ulrich Germann
0fc80660f3 TSA_tree_iterator::approxOccurrenceCount() now returns exact count for small values. 2014-06-03 15:44:20 +01:00
Ulrich Germann
a248349da3 Added more phrase table features and configuration options to Mmsapt. 2014-06-03 15:41:59 +01:00
Ulrich Germann
077f2ab51e Added some code to Word.cpp to allow factor-less decoding.
Factor-less decoding currently works ONLY with suffix-array-based phrase tables.
2014-06-03 15:38:28 +01:00
Hieu Hoang
23e9083514 erroneous assert 2014-06-03 14:40:00 +01:00
Hieu Hoang
8ba078c1eb erroneous assert 2014-06-03 14:06:40 +01:00
Jun-ya NORIMATSU
65bf623228 tuning. 2014-06-03 16:13:32 +09:00
Philipp Koehn
b1d09352ca change default language model training to kenlm 2014-06-02 22:20:16 -04:00
Kenneth Heafield
dd03f9fb69 KenLM 5a7efd8fe1db88ee0a9f7e9479b24ac3ca348221 with Hieu's patch to exception.hh 2014-06-02 10:29:40 -07:00
Hieu Hoang
31a583b0bc update comments for Evaluate() to say something about stackVec 2014-06-02 18:17:39 +01:00
Barry Haddow
5b0c696710 Range check in OSM 2014-06-02 16:23:55 +01:00
Maarten van Gompel
1818bfe3fa reverting my debug changes, clean with main repo now 2014-06-02 14:54:16 +02:00
Maarten van Gompel
d3a67d09af Revert "Revert "Revert "debug"""
This reverts commit 794281ad9e.
2014-06-02 14:49:20 +02:00
Maarten van Gompel
794281ad9e Revert "Revert "debug""
This reverts commit 925000f681.
2014-06-02 14:48:28 +02:00
Maarten van Gompel
925000f681 Revert "debug"
This reverts commit 069b56dac5.
2014-06-02 14:47:42 +02:00
Maarten van Gompel
a46eae089f Revert "debug"
This reverts commit 0216189b81.
2014-06-02 14:47:20 +02:00
Maarten van Gompel
bdc60e40bc Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version.. 2014-06-02 14:41:33 +02:00
Maarten van Gompel
0b5825a853 Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version.. 2014-06-02 14:38:32 +02:00
Maarten van Gompel
bae4ad6253 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-02 14:05:40 +02:00
Ulrich Germann
ce435d22bf Mmsapt now adds the phrase penalty only if num_features specified
on the respective line in moses.ini is odd.
2014-06-01 18:23:00 +01:00
Hieu Hoang
c4d0f7dc93 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-05-31 19:52:41 +01:00
Hieu Hoang
7909dcf094 add decoder arg -weight-add 2014-05-31 19:52:30 +01:00
Ulrich Germann
d1e5a544f1 Word.CreateFromString() now bypasses factor splitting if the factor delimiter is th empty string (specify as: none). 2014-05-31 15:22:37 +01:00
Ulrich Germann
249c40ec74 Eliminated factor delimiter from the parameters of
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00