Hieu Hoang
f04ba0432d
delete debug messages
2013-05-09 13:10:37 +01:00
Hieu Hoang
02063f2413
delete makefiles
2013-05-08 15:09:55 +01:00
Hieu Hoang
1207f27104
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-08 15:07:42 +01:00
Hieu Hoang
eae4201e70
delete debug messages
2013-05-08 11:38:09 +01:00
Hieu Hoang
644cac03f6
eclipse
2013-05-07 11:40:03 +01:00
Rico Sennrich
ce5311c076
fix undefined behaviour in rule extract (thanks Barry)
2013-05-07 10:50:19 +02:00
Rico Sennrich
86cbe7b93b
fix multimodel thread-safety check
2013-05-03 11:55:42 +02:00
Barry Haddow
652d0f0a94
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-03 10:15:55 +01:00
Barry Haddow
8a965cd62e
Fixes to binarize-all
2013-05-03 10:15:37 +01:00
Rico Sennrich
a52f0a8c4d
avoid costly copy operation in extract-rules
...
(noticeable speed-up with large number of non-terminals:
2x speed-up in benchmark with target syntax and --MaxNonTerm 5)
2013-05-03 10:48:14 +02:00
Barry Haddow
8993339df4
Make sure tuning uses filtered config when available.
2013-05-02 18:50:21 +01:00
Barry Haddow
cf47ad132c
Ability to specify number of conf net weights
2013-05-02 18:50:03 +01:00
Barry Haddow
48fe0610ef
Merge branch 'master' of github.com:moses-smt/mosesdecoder
...
Conflicts:
scripts/training/filter-model-given-input.pl
2013-05-02 17:02:51 +01:00
Barry Haddow
5eebb9538e
Enable skipping of filtering in EMS
...
Use 'binarize-all = path-to-binarize-model.perl
2013-05-02 15:15:52 +01:00
Barry Haddow
72cbadaed5
Back to type 99
2013-05-02 15:11:17 +01:00
Rico Sennrich
70670f3af5
automatically determine if multimodel is threadsafe or not (based on thread-safety of component models)
2013-05-02 13:36:06 +02:00
Rico Sennrich
adb7de6e61
support for binary models with multimodelcounts
2013-05-02 12:14:17 +02:00
Ondrej Bojar
0450fd6776
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2013-05-02 00:33:52 +02:00
Ondrej Bojar
b57f5a530e
allow disabling distortion model binarization
2013-05-02 00:33:09 +02:00
Barry Haddow
5638aa6a32
don't rebuild tables when a TRAINING:config is specified
2013-05-01 11:25:32 +01:00
Ondrej Bojar
3e2b83444d
gzip ttable when binarizing, use --tempdir, fixed a flushing bug
2013-05-01 11:49:58 +02:00
Barry Haddow
5af92196b2
remove, no longer required
2013-05-01 09:00:13 +01:00
Barry Haddow
12b129341e
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-01 08:43:59 +01:00
Barry Haddow
b38c318e84
Update to use multi model
2013-04-30 14:04:39 +01:00
Barry Haddow
e5526c6859
Multi model interpolation of binarised - thread safety
2013-04-30 14:04:15 +01:00
Tetsuo Kiso
b107340800
Add explicit to the Search constructor; fix the comments.
2013-04-30 16:20:08 +09:00
Tetsuo Kiso
4650e30380
Add const.
2013-04-30 15:28:57 +09:00
Tetsuo Kiso
9bfb965c2f
Add some comments for the type of search algorithms
2013-04-30 15:00:06 +09:00
Tetsuo Kiso
b9d68e90c7
Fix the obsolete, inconsistent comments.
...
The member functions have no arguments now.
2013-04-30 14:39:35 +09:00
Barry Haddow
3d50142b98
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-29 20:52:41 +01:00
Barry Haddow
aef619a8fd
Support for interpolation of binarised models
2013-04-29 20:51:00 +01:00
Lane Schwartz
ef3d30146a
Re-enabled commented out code.
...
Hopefully this commit will now compile on all versions of Boost.
2013-04-29 12:24:44 -04:00
Lane Schwartz
62e1bf05d6
Added slightly more unit test coverage for backward LM.
2013-04-29 09:18:46 -04:00
Lane Schwartz
afa270a2e6
Initial unit test for BackwardLanguageModel Evaluate method
2013-04-29 09:18:46 -04:00
Lane Schwartz
e5de2e5917
Checking in changes.
...
This currently doesn't compile.
Need to debug why.
2013-04-29 09:18:46 -04:00
Lane Schwartz
4a44c4682b
Work on BackwardLM unit testing
2013-04-29 09:18:46 -04:00
Lane Schwartz
aacc936204
Adding unit tests to Backward LM
2013-04-29 09:18:46 -04:00
Lane Schwartz
95e3a37469
Added CalcScore to BackwardLanguageModel
2013-04-29 09:18:45 -04:00
Lane Schwartz
d340218fd4
BackwardLM now can calculate its empty state
2013-04-29 09:18:45 -04:00
Lane Schwartz
8459a86137
Refactoring code from Ken.cpp into Ken.h
...
in preparation for implemenation of backward language model
from Xiong et al (2011)
2013-04-29 09:18:45 -04:00
Kenneth Heafield
972001e345
Compiler error
2013-04-27 01:02:52 +02:00
Kenneth Heafield
b836753ec2
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-25 22:52:06 +02:00
Kenneth Heafield
38b29e2c79
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-25 22:51:26 +02:00
Kenneth Heafield
2437ed441d
Accept cmph with lib64 too
2013-04-25 21:50:05 +01:00
Kenneth Heafield
f1d3663810
Back FactorCollection with a memory pool. Less memory for large vocabularies.
2013-04-25 19:42:30 +01:00
Hieu Hoang
4b4aba3d81
log probabilities. /Abby
2013-04-25 16:54:45 +01:00
Rico Sennrich
4e87a012d0
fix two bugs with relax-parse:
...
- size of sentence was not calculated correctly
(instead, number of positions at which a subtree starts was used)
- code entered an infinitive loop sometimes; added break condition
2013-04-25 17:27:50 +02:00
Kenneth Heafield
8a1e944bb4
Error messages
2013-04-23 08:36:24 +01:00
Rico Sennrich
908c006e32
online combination of multiple phrase tables
...
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
- linear interpolation or instance weighting
- two possible component model types supported so far: 0 (in-memory) or 12 (compact)
- weights can be set in config, and overriden on a sentence-level through mosesserver API
- online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Christian Buck
477f913585
mosesserver now supports nbest lists
2013-04-21 00:34:59 +01:00