Commit Graph

52 Commits

Author SHA1 Message Date
Hieu Hoang
47465f8afb start framework for evaluating target phrase score 2013-05-02 14:55:26 +01:00
Hieu Hoang
c99e9f8c90 start framework for evaluating target phrase score 2013-05-02 12:15:26 +01:00
Hieu Hoang
4894df6494 merge 2013-04-29 19:04:00 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Lane Schwartz
62e1bf05d6 Added slightly more unit test coverage for backward LM. 2013-04-29 09:18:46 -04:00
Lane Schwartz
afa270a2e6 Initial unit test for BackwardLanguageModel Evaluate method 2013-04-29 09:18:46 -04:00
Lane Schwartz
e5de2e5917 Checking in changes.
This currently doesn't compile.

Need to debug why.
2013-04-29 09:18:46 -04:00
Lane Schwartz
4a44c4682b Work on BackwardLM unit testing 2013-04-29 09:18:46 -04:00
Lane Schwartz
aacc936204 Adding unit tests to Backward LM 2013-04-29 09:18:46 -04:00
Lane Schwartz
95e3a37469 Added CalcScore to BackwardLanguageModel 2013-04-29 09:18:45 -04:00
Lane Schwartz
d340218fd4 BackwardLM now can calculate its empty state 2013-04-29 09:18:45 -04:00
Lane Schwartz
8459a86137 Refactoring code from Ken.cpp into Ken.h
in preparation for implemenation of backward language model
from Xiong et al (2011)
2013-04-29 09:18:45 -04:00
Hieu Hoang
f5d3f16fab rescale LM score for chart decoding by KenLM. All regression tests passes 2013-04-29 13:01:26 +01:00
Hieu Hoang
aa9689d12b rescale LM score for chart decoding 2013-04-26 19:39:29 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
68b64974c4 runtime error using name args with language models 2013-03-19 12:19:39 +00:00
Hieu Hoang
b4ab054453 merge error 2013-03-16 16:18:51 +00:00
Hieu Hoang
7888c7ba23 eclipse project files 2013-03-15 22:02:00 +00:00
Hieu Hoang
974bdd979b memory leak 2013-03-15 14:19:36 +00:00
Hieu Hoang
9f33f5ba7e load scfg on-disk pt 2013-02-25 14:19:48 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00
Hieu Hoang
56506281c5 move class PointerState into its own file 2013-02-21 14:48:23 +00:00
Hieu Hoang
ce26defbf7 move class LanguageModelChartState into its own file 2013-02-21 14:29:51 +00:00
Hieu Hoang
28d189ffe6 delete Useable() 2013-02-21 13:21:03 +00:00
Hieu Hoang
8e6c65d43b delete InitializeBeforeSentenceProcessing() and CleanUpAfterSentenceProcessing() 2013-02-21 13:01:36 +00:00
Hieu Hoang
eca3661de3 rename a variable and function 2013-02-21 11:30:54 +00:00
Hieu Hoang
a0927b98e6 delete class LMRefCount. Merge LM and LM implementation back together again 2013-02-20 23:36:04 +00:00
Hieu Hoang
ab44825f29 delete GetLMType() 2013-02-20 23:02:09 +00:00
Hieu Hoang
ab56be4ee6 delete Duplicate() 2013-02-20 22:52:47 +00:00
Hieu Hoang
1a1634a391 make LanguageModelImplementation have new format constructor 2013-02-20 22:44:11 +00:00
Hieu Hoang
165ed39296 delete LanguageModelPointerState 2013-02-20 22:09:00 +00:00
Hieu Hoang
e0746cd525 throw exception if unknown argument 2013-02-19 17:31:11 +00:00
Hieu Hoang
f7e3f20013 each language model should have separate description, rather than just 'LM' 2013-02-06 20:05:00 +00:00
Hieu Hoang
9d0c4801d5 name-value pairs for LM arguments 2013-02-04 23:10:12 +00:00
Hieu Hoang
2573d0a122 delete LM/Factory.* 2013-02-01 21:01:44 +00:00
Hieu Hoang
530e859697 tokenize line now moved into base class ScoreProducer 2013-02-01 20:23:36 +00:00
Hieu Hoang
a57ac78741 refactor LanguageModelIRST 2013-01-17 17:58:44 +00:00
Hieu Hoang
75ef646918 refactor LanguageModel 2013-01-17 17:15:10 +00:00
Hieu Hoang
bf58eac8bc clean up InitializeBeforeSentenceProcessing() 2012-12-24 18:52:04 +00:00
Hieu Hoang
27df7efd6a clean up InitializeBeforeSentenceProcessing() 2012-12-24 17:42:08 +00:00
Hieu Hoang
0df397065d clean up InitializeBeforeSentenceProcessing() 2012-12-24 16:52:40 +00:00
Hieu Hoang
50f666f397 clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:37:11 +00:00
Hieu Hoang
961cc53ae5 clean up CleanUpAfterSentenceProcessing() 2012-12-24 14:34:34 +00:00
Hieu Hoang
f212927368 get rid of all overrides for GetScoreProducerDescription(). Except SyntacticLM - not sure if it should be separated from LM or not 2012-12-07 16:05:50 +00:00
Hieu Hoang
9fe742ce52 get rid function GetScoreProducerWeightShortName(). Fails 1 regression test 2012-12-04 17:09:23 +00:00
Hieu Hoang
33105a7ba7 get rid of int argument from GetScoreProducerWeightShortName() 2012-12-04 13:08:00 +00:00
Hieu Hoang
ae8a48b022 move Score3Parser to TranslationModel/ 2012-11-27 17:09:23 +00:00
Hieu Hoang
4d8e4ae6d8 move DynSAInclude to TranslationModel/ 2012-11-27 16:16:30 +00:00
Kenneth Heafield
6a3fdcd8c0 Rename Incremental/Manager.cpp to just Incremental.cpp 2012-11-15 22:10:30 +00:00
Hieu Hoang
065597dc9f only include moses root when compiling 2012-11-14 14:18:53 +00:00