Commit Graph

10057 Commits

Author SHA1 Message Date
Hieu Hoang
b83a056f9f merge. mostly discard 2013-04-30 11:01:55 +01:00
Tetsuo Kiso
b107340800 Add explicit to the Search constructor; fix the comments. 2013-04-30 16:20:08 +09:00
Tetsuo Kiso
4650e30380 Add const. 2013-04-30 15:28:57 +09:00
Tetsuo Kiso
9bfb965c2f Add some comments for the type of search algorithms 2013-04-30 15:00:06 +09:00
Tetsuo Kiso
b9d68e90c7 Fix the obsolete, inconsistent comments.
The member functions have no arguments now.
2013-04-30 14:39:35 +09:00
Barry Haddow
3d50142b98 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-29 20:52:41 +01:00
Barry Haddow
aef619a8fd Support for interpolation of binarised models 2013-04-29 20:51:00 +01:00
Hieu Hoang
4894df6494 merge 2013-04-29 19:04:00 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Lane Schwartz
ef3d30146a Re-enabled commented out code.
Hopefully this commit will now compile on all versions of Boost.
2013-04-29 12:24:44 -04:00
Lane Schwartz
62e1bf05d6 Added slightly more unit test coverage for backward LM. 2013-04-29 09:18:46 -04:00
Lane Schwartz
afa270a2e6 Initial unit test for BackwardLanguageModel Evaluate method 2013-04-29 09:18:46 -04:00
Lane Schwartz
e5de2e5917 Checking in changes.
This currently doesn't compile.

Need to debug why.
2013-04-29 09:18:46 -04:00
Lane Schwartz
4a44c4682b Work on BackwardLM unit testing 2013-04-29 09:18:46 -04:00
Lane Schwartz
aacc936204 Adding unit tests to Backward LM 2013-04-29 09:18:46 -04:00
Lane Schwartz
95e3a37469 Added CalcScore to BackwardLanguageModel 2013-04-29 09:18:45 -04:00
Lane Schwartz
d340218fd4 BackwardLM now can calculate its empty state 2013-04-29 09:18:45 -04:00
Lane Schwartz
8459a86137 Refactoring code from Ken.cpp into Ken.h
in preparation for implemenation of backward language model
from Xiong et al (2011)
2013-04-29 09:18:45 -04:00
Hieu Hoang
f5d3f16fab rescale LM score for chart decoding by KenLM. All regression tests passes 2013-04-29 13:01:26 +01:00
Kenneth Heafield
972001e345 Compiler error 2013-04-27 01:02:52 +02:00
Hieu Hoang
aa9689d12b rescale LM score for chart decoding 2013-04-26 19:39:29 +01:00
Hieu Hoang
8edbfebbf1 word penalty for XML options 2013-04-26 17:49:11 +01:00
Hieu Hoang
83494418e2 delete PhraseDictionaryMemory. Fix word penalty in compact phrase table 2013-04-26 15:55:32 +01:00
Hieu Hoang
69453f0a8b don't convert LM score from 1 log to another for chart decoding 2013-04-26 14:27:44 +01:00
Hieu Hoang
b448c6285a make scfg work with factored input. Strip factors from source that are not part of phrase-table input factors 2013-04-26 12:20:49 +01:00
Kenneth Heafield
b836753ec2 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-25 22:52:06 +02:00
Kenneth Heafield
38b29e2c79 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-04-25 22:51:26 +02:00
Kenneth Heafield
2437ed441d Accept cmph with lib64 too 2013-04-25 21:50:05 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
75c85acd5e delete PhraseDictionaryMemory. Use PhraseDictionarySCFG 2013-04-25 18:24:02 +01:00
Hieu Hoang
4b4aba3d81 log probabilities. /Abby 2013-04-25 16:54:45 +01:00
Rico Sennrich
4e87a012d0 fix two bugs with relax-parse:
- size of sentence was not calculated correctly
    (instead, number of positions at which a subtree starts was used)
  - code entered an infinitive loop sometimes; added break condition
2013-04-25 17:27:50 +02:00
Hieu Hoang
b53b93f09f gt rid of word penalty of 0.434. Adjust weight accordingly 2013-04-24 19:23:14 +01:00
Hieu Hoang
6da2cf7663 eclipse 2013-04-24 14:19:16 +01:00
Hieu Hoang
2d265344d1 delete m_currScoreBreakdown 2013-04-24 13:44:11 +01:00
Hieu Hoang
d9b1784373 delete different calc functions 2013-04-24 13:23:22 +01:00
Hieu Hoang
c84605a241 delete different calc functions 2013-04-24 13:13:50 +01:00
Hieu Hoang
16cbf692d3 delete different calc functions 2013-04-24 12:10:56 +01:00
Kenneth Heafield
8a1e944bb4 Error messages 2013-04-23 08:36:24 +01:00
Hieu Hoang
3248a8e4f4 initialise m_currScoreBreakdown with score from transOpt 2013-04-22 21:25:36 +01:00
Hieu Hoang
5126aa8e30 word penalty is a cached stateless feature 2013-04-22 21:17:52 +01:00
Hieu Hoang
bf057dc46b get rid of ResetScore() from Hypothesis and TargetPhrase class 2013-04-22 20:12:43 +01:00
Hieu Hoang
5655a6cf1b get rid of tempScoreBreakdown. Not sure what it was for 2013-04-22 18:38:42 +01:00
Hieu Hoang
3bfcdd0077 minor changes for debuggablility 2013-04-22 13:03:07 +01:00
Rico Sennrich
908c006e32 online combination of multiple phrase tables
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
  - linear interpolation or instance weighting
  - two possible component model types supported so far: 0 (in-memory) or 12 (compact)
  - weights can be set in config, and overriden on a sentence-level through mosesserver API
  - online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Christian Buck
477f913585 mosesserver now supports nbest lists 2013-04-21 00:34:59 +01:00
Christian Buck
b362791169 fixed warnings 2013-04-21 00:34:25 +01:00
Christian Buck
046e031723 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2013-04-20 20:33:16 +01:00
Hieu Hoang
b1da4dbe0e merged 2013-04-19 15:03:34 +01:00
Barry Haddow
7677832655 Fix markdown 2013-04-19 09:00:24 +01:00