Commit Graph

9735 Commits

Author SHA1 Message Date
Hieu Hoang
f04ba0432d delete debug messages 2013-05-09 13:10:37 +01:00
Hieu Hoang
02063f2413 delete makefiles 2013-05-08 15:09:55 +01:00
Hieu Hoang
1207f27104 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-08 15:07:42 +01:00
Hieu Hoang
eae4201e70 delete debug messages 2013-05-08 11:38:09 +01:00
Hieu Hoang
644cac03f6 eclipse 2013-05-07 11:40:03 +01:00
Rico Sennrich
ce5311c076 fix undefined behaviour in rule extract (thanks Barry) 2013-05-07 10:50:19 +02:00
Rico Sennrich
86cbe7b93b fix multimodel thread-safety check 2013-05-03 11:55:42 +02:00
Barry Haddow
652d0f0a94 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-03 10:15:55 +01:00
Barry Haddow
8a965cd62e Fixes to binarize-all 2013-05-03 10:15:37 +01:00
Rico Sennrich
a52f0a8c4d avoid costly copy operation in extract-rules
(noticeable speed-up with large number of non-terminals:
2x speed-up in benchmark with target syntax and --MaxNonTerm 5)
2013-05-03 10:48:14 +02:00
Barry Haddow
8993339df4 Make sure tuning uses filtered config when available. 2013-05-02 18:50:21 +01:00
Barry Haddow
cf47ad132c Ability to specify number of conf net weights 2013-05-02 18:50:03 +01:00
Barry Haddow
48fe0610ef Merge branch 'master' of github.com:moses-smt/mosesdecoder
Conflicts:
	scripts/training/filter-model-given-input.pl
2013-05-02 17:02:51 +01:00
Barry Haddow
5eebb9538e Enable skipping of filtering in EMS
Use 'binarize-all = path-to-binarize-model.perl
2013-05-02 15:15:52 +01:00
Barry Haddow
72cbadaed5 Back to type 99 2013-05-02 15:11:17 +01:00
Rico Sennrich
70670f3af5 automatically determine if multimodel is threadsafe or not (based on thread-safety of component models) 2013-05-02 13:36:06 +02:00
Rico Sennrich
adb7de6e61 support for binary models with multimodelcounts 2013-05-02 12:14:17 +02:00
Ondrej Bojar
0450fd6776 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2013-05-02 00:33:52 +02:00
Ondrej Bojar
b57f5a530e allow disabling distortion model binarization 2013-05-02 00:33:09 +02:00
Barry Haddow
5638aa6a32 don't rebuild tables when a TRAINING:config is specified 2013-05-01 11:25:32 +01:00
Ondrej Bojar
3e2b83444d gzip ttable when binarizing, use --tempdir, fixed a flushing bug 2013-05-01 11:49:58 +02:00
Barry Haddow
5af92196b2 remove, no longer required 2013-05-01 09:00:13 +01:00
Barry Haddow
12b129341e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-01 08:43:59 +01:00
Barry Haddow
b38c318e84 Update to use multi model 2013-04-30 14:04:39 +01:00
Barry Haddow
e5526c6859 Multi model interpolation of binarised - thread safety 2013-04-30 14:04:15 +01:00
Tetsuo Kiso
b107340800 Add explicit to the Search constructor; fix the comments. 2013-04-30 16:20:08 +09:00
Tetsuo Kiso
4650e30380 Add const. 2013-04-30 15:28:57 +09:00
Tetsuo Kiso
9bfb965c2f Add some comments for the type of search algorithms 2013-04-30 15:00:06 +09:00
Tetsuo Kiso
b9d68e90c7 Fix the obsolete, inconsistent comments.
The member functions have no arguments now.
2013-04-30 14:39:35 +09:00
Barry Haddow
3d50142b98 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-29 20:52:41 +01:00
Barry Haddow
aef619a8fd Support for interpolation of binarised models 2013-04-29 20:51:00 +01:00
Lane Schwartz
ef3d30146a Re-enabled commented out code.
Hopefully this commit will now compile on all versions of Boost.
2013-04-29 12:24:44 -04:00
Lane Schwartz
62e1bf05d6 Added slightly more unit test coverage for backward LM. 2013-04-29 09:18:46 -04:00
Lane Schwartz
afa270a2e6 Initial unit test for BackwardLanguageModel Evaluate method 2013-04-29 09:18:46 -04:00
Lane Schwartz
e5de2e5917 Checking in changes.
This currently doesn't compile.

Need to debug why.
2013-04-29 09:18:46 -04:00
Lane Schwartz
4a44c4682b Work on BackwardLM unit testing 2013-04-29 09:18:46 -04:00
Lane Schwartz
aacc936204 Adding unit tests to Backward LM 2013-04-29 09:18:46 -04:00
Lane Schwartz
95e3a37469 Added CalcScore to BackwardLanguageModel 2013-04-29 09:18:45 -04:00
Lane Schwartz
d340218fd4 BackwardLM now can calculate its empty state 2013-04-29 09:18:45 -04:00
Lane Schwartz
8459a86137 Refactoring code from Ken.cpp into Ken.h
in preparation for implemenation of backward language model
from Xiong et al (2011)
2013-04-29 09:18:45 -04:00
Kenneth Heafield
972001e345 Compiler error 2013-04-27 01:02:52 +02:00
Kenneth Heafield
b836753ec2 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-25 22:52:06 +02:00
Kenneth Heafield
38b29e2c79 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-25 22:51:26 +02:00
Kenneth Heafield
2437ed441d Accept cmph with lib64 too 2013-04-25 21:50:05 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
4b4aba3d81 log probabilities. /Abby 2013-04-25 16:54:45 +01:00
Rico Sennrich
4e87a012d0 fix two bugs with relax-parse:
- size of sentence was not calculated correctly
    (instead, number of positions at which a subtree starts was used)
  - code entered an infinitive loop sometimes; added break condition
2013-04-25 17:27:50 +02:00
Kenneth Heafield
8a1e944bb4 Error messages 2013-04-23 08:36:24 +01:00
Rico Sennrich
908c006e32 online combination of multiple phrase tables
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
  - linear interpolation or instance weighting
  - two possible component model types supported so far: 0 (in-memory) or 12 (compact)
  - weights can be set in config, and overriden on a sentence-level through mosesserver API
  - online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Christian Buck
477f913585 mosesserver now supports nbest lists 2013-04-21 00:34:59 +01:00