Philipp Koehn
fc8e588f25
kbmira bug fix & factor handling
2014-06-06 14:20:57 +01:00
phikoehn
ae20251bf3
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-06 14:14:50 +01:00
phikoehn
ac7670c5e7
minor bugs with factors
2014-06-06 14:14:35 +01:00
Rico Sennrich
76b6a5b6c9
compatibility with more python versions (python3; 2.7.3)
2014-06-06 10:32:23 +01:00
phikoehn
7fc3ccd968
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-05 21:37:20 +01:00
Philipp Koehn
243004bda6
utf8 compatible
2014-06-05 21:36:18 +01:00
phikoehn
ceadacd3af
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2014-06-05 21:33:35 +01:00
Philipp Koehn
15288213be
allow < > in factors
2014-06-05 21:31:09 +01:00
Hieu Hoang
33a0b97cc9
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-05 17:15:24 +01:00
Hieu Hoang
d29bf716a4
minor change to debugging output. Memory pt used by both pb and chart-based models
2014-06-05 17:15:08 +01:00
Jun-ya NORIMATSU
cc71e0ee54
bugfix.
2014-06-05 19:26:27 +09:00
Jun-ya NORIMATSU
0659c31c05
Merge remote-tracking branch 'origin/master'
2014-06-05 14:24:44 +09:00
Jun-ya NORIMATSU
1180f5dd70
bug fix.
2014-06-05 14:24:10 +09:00
Kenneth Heafield
6d9173ba72
KenLM f81d02792087a837ea17e6ce2b33f9b7aaecca68 should fix segfault with ArrayTrie
2014-06-04 16:03:39 -07:00
Kenneth Heafield
d82bd475a2
Nadir Durrani asked me to add this script
2014-06-04 11:27:36 -07:00
Hieu Hoang
b2de22fccb
Merge pull request #65 from proycon/master
...
python-contrib was not up to date anymore with current PhraseDictionaryTree() constructor: fixed and reran cython (newer version) to generate cpp
2014-06-04 12:40:54 +01:00
Barry Haddow
ea37abbf45
lm query output has been modified
2014-06-03 22:13:25 +01:00
Barry Haddow
1a4b641421
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-03 22:13:17 +01:00
Ulrich Germann
729910883a
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-06-03 19:25:36 +01:00
Ulrich Germann
9c27dc08e9
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
...
Conflicts:
moses/FF/ConstrainedDecoding.cpp
2014-06-03 18:55:53 +01:00
Hieu Hoang
9f5a7b119f
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-06-03 17:10:19 +01:00
Hieu Hoang
3ae671fc7c
||| separator after counts
2014-06-03 17:10:09 +01:00
Kenneth Heafield
346a8f41b0
Use boost::ref for Visual Studio / Mike Ladwig
2014-06-03 08:48:10 -07:00
Ulrich Germann
9cda39f802
Major bug fix in setting ug_bitext::jstats.my_cnt2.
2014-06-03 15:48:27 +01:00
Ulrich Germann
8c9a26a3be
Added phrase feature function for log counts.
2014-06-03 15:45:29 +01:00
Ulrich Germann
0fc80660f3
TSA_tree_iterator::approxOccurrenceCount() now returns exact count for small values.
2014-06-03 15:44:20 +01:00
Ulrich Germann
a248349da3
Added more phrase table features and configuration options to Mmsapt.
2014-06-03 15:41:59 +01:00
Ulrich Germann
077f2ab51e
Added some code to Word.cpp to allow factor-less decoding.
...
Factor-less decoding currently works ONLY with suffix-array-based phrase tables.
2014-06-03 15:38:28 +01:00
Hieu Hoang
23e9083514
erroneous assert
2014-06-03 14:40:00 +01:00
Hieu Hoang
8ba078c1eb
erroneous assert
2014-06-03 14:06:40 +01:00
Jun-ya NORIMATSU
65bf623228
tuning.
2014-06-03 16:13:32 +09:00
Philipp Koehn
b1d09352ca
change default language model training to kenlm
2014-06-02 22:20:16 -04:00
Kenneth Heafield
dd03f9fb69
KenLM 5a7efd8fe1db88ee0a9f7e9479b24ac3ca348221 with Hieu's patch to exception.hh
2014-06-02 10:29:40 -07:00
Hieu Hoang
31a583b0bc
update comments for Evaluate() to say something about stackVec
2014-06-02 18:17:39 +01:00
Barry Haddow
5b0c696710
Range check in OSM
2014-06-02 16:23:55 +01:00
Maarten van Gompel
1818bfe3fa
reverting my debug changes, clean with main repo now
2014-06-02 14:54:16 +02:00
Maarten van Gompel
d3a67d09af
Revert "Revert "Revert "debug"""
...
This reverts commit 794281ad9e
2014-06-02 14:49:20 +02:00
Maarten van Gompel
794281ad9e
Revert "Revert "debug""
...
This reverts commit 925000f681
2014-06-02 14:48:28 +02:00
Maarten van Gompel
925000f681
Revert "debug"
...
This reverts commit 069b56dac5
2014-06-02 14:47:42 +02:00
Maarten van Gompel
a46eae089f
Revert "debug"
...
This reverts commit 0216189b81
2014-06-02 14:47:20 +02:00
Maarten van Gompel
bdc60e40bc
Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version..
2014-06-02 14:41:33 +02:00
Maarten van Gompel
0b5825a853
Was not up to date anymore with current PhraseDictionaryTree() constructor, the parameterer nscores seems no longer required. Adapted Cython code and reran cython (newer version) to generate C++ version..
2014-06-02 14:38:32 +02:00
Maarten van Gompel
bae4ad6253
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2014-06-02 14:05:40 +02:00
Ulrich Germann
ce435d22bf
Mmsapt now adds the phrase penalty only if num_features specified
...
on the respective line in moses.ini is odd.
2014-06-01 18:23:00 +01:00
Hieu Hoang
c4d0f7dc93
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-05-31 19:52:41 +01:00
Hieu Hoang
7909dcf094
add decoder arg -weight-add
2014-05-31 19:52:30 +01:00
Ulrich Germann
d1e5a544f1
Word.CreateFromString() now bypasses factor splitting if the factor delimiter is th empty string (specify as: none).
2014-05-31 15:22:37 +01:00
Ulrich Germann
249c40ec74
Eliminated factor delimiter from the parameters of
...
Phrase.CreateFromString() and Sentence.CreateFromString(),
as it was never used in those functions anyway ---
Word.CreateFromString() retrieves the factor delimiter
from StaticData directly.
2014-05-31 14:33:31 +01:00
Ulrich Germann
c452875343
Mmsapt/ug_bitext:
...
- Sampling now uses a static seed for consistency between runs.
- (In order to have consistency guarantees, specify workers=1 in the
- Mmsapt line in moses.ini; otherwise the randomness of thread scheduling may
cause inconsistencies between runs.
- Denominator for fwd phrase probabilities can now be chosen via an
external argument.
2014-05-31 14:29:44 +01:00
Ulrich Germann
0efea15dbe
mira/MiraOptimizer.cpp: Fixed signed/unsigned integer mismatch in comparisons.
2014-05-31 14:26:43 +01:00
