Jun-ya NORIMATSU
0659c31c05
Merge remote-tracking branch 'origin/master'
2014-06-05 14:24:44 +09:00
Jun-ya NORIMATSU
1180f5dd70
bug fix.
2014-06-05 14:24:10 +09:00
Ulrich Germann
5116f0072b
Minor edits to ug_bitext.h. Added min_diverse to ug_bitext::job to ensure minimum number of translation alternatives before sampling stops.
2014-06-05 01:50:55 +01:00
Ulrich Germann
b92d599727
Bug fix in mmlex-lookup.
2014-06-05 01:48:11 +01:00
Ulrich Germann
2f109621bf
Added configurable options and SetTableLimit to Mmsapt.
2014-06-05 01:47:29 +01:00
Ulrich Germann
a40fcbae02
Added utility lookup_mmsapt
2014-06-05 01:45:34 +01:00
Ulrich Germann
22ec93b85c
Added operator [] to TargetPhraseCollection.
2014-06-05 01:44:11 +01:00
Ulrich Germann
c7a0520a18
Made moses shut up by changing unconditional 'cerr's to VERBOSE(1,...)
2014-06-05 01:43:26 +01:00
Ulrich Germann
004b8c9078
Changed Phrase.m_words from private to protected.
2014-06-05 01:41:50 +01:00
Ulrich Germann
3145bf3cc4
Commented out unused variable.
2014-06-05 01:40:51 +01:00
Ulrich Germann
0e98a08446
Commented out unused variable.
2014-06-05 01:40:27 +01:00
Ulrich Germann
5ae57f09d7
Commented out unused variable.
2014-06-05 01:39:44 +01:00
Ulrich Germann
ce853731ae
Added mmsapt lookup utility.
2014-06-05 01:38:55 +01:00
Kenneth Heafield
6d9173ba72
KenLM f81d02792087a837ea17e6ce2b33f9b7aaecca68 should fix segfault with ArrayTrie
2014-06-04 16:03:39 -07:00
Kenneth Heafield
d82bd475a2
Nadir Durrani asked me to add this script
2014-06-04 11:27:36 -07:00
Hieu Hoang
b2de22fccb
Merge pull request #65 from proycon/master
...
python-contrib was not up to date anymore with current PhraseDictionaryTree() constructor: fixed and reran cython (newer version) to generate cpp
2014-06-04 12:40:54 +01:00
Barry Haddow
ea37abbf45
lm query output has been modified
2014-06-03 22:13:25 +01:00
Barry Haddow
1a4b641421
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-03 22:13:17 +01:00
Ulrich Germann
8dee1725fb
Removed Phrase penalty as a built-in feature function.
2014-06-03 21:36:04 +01:00
Ulrich Germann
729910883a
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-06-03 19:25:36 +01:00
Ulrich Germann
9c27dc08e9
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/FF/ConstrainedDecoding.cpp
2014-06-03 18:55:53 +01:00
Hieu Hoang
9f5a7b119f
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-03 17:10:19 +01:00
Hieu Hoang
3ae671fc7c
||| separator after counts
2014-06-03 17:10:09 +01:00
Kenneth Heafield
346a8f41b0
Use boost::ref for Visual Studio / Mike Ladwig
2014-06-03 08:48:10 -07:00
Ulrich Germann
9cda39f802
Major bug fix in setting ug_bitext::jstats.my_cnt2.
2014-06-03 15:48:27 +01:00
Ulrich Germann
8c9a26a3be
Added phrase feature function for log counts.
2014-06-03 15:45:29 +01:00
Ulrich Germann
0fc80660f3
TSA_tree_iterator::approxOccurrenceCount() now returns exact count for small values.
2014-06-03 15:44:20 +01:00
Ulrich Germann
a248349da3
Added more phrase table features and configuration options to Mmsapt.
2014-06-03 15:41:59 +01:00
Ulrich Germann
077f2ab51e
Added some code to Word.cpp to allow factor-less decoding.
...
Factor-less decoding currently works ONLY with suffix-array-based phrase tables.
2014-06-03 15:38:28 +01:00
Hieu Hoang
23e9083514
erroneous assert
2014-06-03 14:40:00 +01:00
Hieu Hoang
8ba078c1eb
erroneous assert
2014-06-03 14:06:40 +01:00
Jun-ya NORIMATSU
65bf623228
tuning.
2014-06-03 16:13:32 +09:00
Philipp Koehn
b1d09352ca
change default language model training to kenlm
2014-06-02 22:20:16 -04:00
Kenneth Heafield
dd03f9fb69
KenLM 5a7efd8fe1db88ee0a9f7e9479b24ac3ca348221 with Hieu's patch to exception.hh
2014-06-02 10:29:40 -07:00
Hieu Hoang
31a583b0bc
update comments for Evaluate() to say something about stackVec
2014-06-02 18:17:39 +01:00
Barry Haddow
5b0c696710
Range check in OSM
2014-06-02 16:23:55 +01:00
Maarten van Gompel
1818bfe3fa
reverting my debug changes, clean with main repo now
2014-06-02 14:54:16 +02:00
Maarten van Gompel
d3a67d09af
Revert "Revert "Revert "debug"""
...
This reverts commit 794281ad9e
2014-06-02 14:49:20 +02:00
Maarten van Gompel
794281ad9e
Revert "Revert "debug""
...
This reverts commit 925000f681
2014-06-02 14:48:28 +02:00
Maarten van Gompel
925000f681
Revert "debug"
...
This reverts commit 069b56dac5
2014-06-02 14:47:42 +02:00
Maarten van Gompel
a46eae089f
Revert "debug"
...
This reverts commit 0216189b81
2014-06-02 14:47:20 +02:00
Maarten van Gompel
bdc60e40bc
Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version..
2014-06-02 14:41:33 +02:00
Maarten van Gompel
0b5825a853
Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version..
2014-06-02 14:38:32 +02:00
Maarten van Gompel
bae4ad6253
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-06-02 14:05:40 +02:00
Ulrich Germann
ce435d22bf
Mmsapt now adds the phrase penalty only if num_features specified
...
on the respective line in moses.ini is odd.
2014-06-01 18:23:00 +01:00
Hieu Hoang
c4d0f7dc93
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-05-31 19:52:41 +01:00
Hieu Hoang
7909dcf094
add decoder arg -weight-add
2014-05-31 19:52:30 +01:00
Ulrich Germann
d1e5a544f1
Word.CreateFromString() now bypasses factor splitting if the factor delimiter is th empty string (specify as: none).
2014-05-31 15:22:37 +01:00
Ulrich Germann
249c40ec74
Eliminated factor delimiter from the parameters of
...
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00
Ulrich Germann
c452875343
Mmsapt/ug_bitext:
...
- Sampling now uses a static seed for consistency between runs.
- (In order to have consistency guarantees, specify workers=1 in the
- Mmsapt line in moses.ini; otherwise the randomness of thread scheduling may
cause inconsistencies between runs.
- Denominator for fwd phrase probabilities can now be chosen via an
external argument.
2014-05-31 14:29:44 +01:00
