Commit Graph

73 Commits

Author SHA1 Message Date
Hieu Hoang
e2c2bc59f1 beautify 2013-07-25 15:23:05 +01:00
Hieu Hoang
206b165d14 randlm compile with refactored code. No regression tests yet 2013-07-23 12:56:35 +01:00
Hieu Hoang
5b7a9af588 refactor RandLM. Compiles with eclipse but not with bjam 2013-07-20 00:19:04 +01:00
Kenneth Heafield
e1a2b2f0c9 Reduce scope of lm dependency 2013-07-19 18:50:12 +01:00
Kenneth Heafield
b5e6b9c959 Factory 2013-07-18 22:54:52 +01:00
Hieu Hoang
f35750bc08 beautify 2013-07-04 20:19:51 +01:00
Nadir Durrani
6a915253e1 Bug Fix 2013-07-01 11:06:55 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
7f1a6041ba explicitly declare how many scores there are in language model features 2013-06-04 21:49:37 +01:00
Hieu Hoang
21ff6d4831 beautify 2013-06-03 12:33:18 +01:00
Hieu Hoang
695617d930 consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:50:13 +01:00
Hieu Hoang
eaf53769ad consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:21:02 +01:00
Hieu Hoang
bc0fdfbd79 delete LM:Useable(). Superseded by IsUseable() for all feature functions 2013-05-31 00:11:38 +01:00
Hieu Hoang
83c4477841 figure out which feature function to apply at which decode step. Book-keeping 2013-05-30 12:41:08 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
b5bb500773 move GetFirstLM() as static method of LanguageModel 2013-05-28 17:35:06 +01:00
Hieu Hoang
537e9373f8 minor warnings 2013-05-28 11:57:13 +01:00
Hieu Hoang
d647dd8aa3 delete sourcePhrase variable in TargetPhrase class 2013-05-28 10:51:28 +01:00
Hieu Hoang
75a1849bcf split classes in FeatureFunction files 2013-05-24 19:11:15 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
41da563645 port SRILM to new weights format 2013-05-19 12:44:45 +01:00
Hieu Hoang
47465f8afb start framework for evaluating target phrase score 2013-05-02 14:55:26 +01:00
Hieu Hoang
c99e9f8c90 start framework for evaluating target phrase score 2013-05-02 12:15:26 +01:00
Hieu Hoang
4894df6494 merge 2013-04-29 19:04:00 +01:00
Hieu Hoang
ce95c117f6 merge 2013-04-29 18:46:48 +01:00
Lane Schwartz
62e1bf05d6 Added slightly more unit test coverage for backward LM. 2013-04-29 09:18:46 -04:00
Lane Schwartz
afa270a2e6 Initial unit test for BackwardLanguageModel Evaluate method 2013-04-29 09:18:46 -04:00
Lane Schwartz
e5de2e5917 Checking in changes.
This currently doesn't compile.

Need to debug why.
2013-04-29 09:18:46 -04:00
Lane Schwartz
4a44c4682b Work on BackwardLM unit testing 2013-04-29 09:18:46 -04:00
Lane Schwartz
aacc936204 Adding unit tests to Backward LM 2013-04-29 09:18:46 -04:00
Lane Schwartz
95e3a37469 Added CalcScore to BackwardLanguageModel 2013-04-29 09:18:45 -04:00
Lane Schwartz
d340218fd4 BackwardLM now can calculate its empty state 2013-04-29 09:18:45 -04:00
Lane Schwartz
8459a86137 Refactoring code from Ken.cpp into Ken.h
in preparation for implemenation of backward language model
from Xiong et al (2011)
2013-04-29 09:18:45 -04:00
Hieu Hoang
f5d3f16fab rescale LM score for chart decoding by KenLM. All regression tests passes 2013-04-29 13:01:26 +01:00
Hieu Hoang
aa9689d12b rescale LM score for chart decoding 2013-04-26 19:39:29 +01:00
Kenneth Heafield
f1d3663810 Back FactorCollection with a memory pool. Less memory for large vocabularies. 2013-04-25 19:42:30 +01:00
Hieu Hoang
68b64974c4 runtime error using name args with language models 2013-03-19 12:19:39 +00:00
Hieu Hoang
b4ab054453 merge error 2013-03-16 16:18:51 +00:00
Hieu Hoang
7888c7ba23 eclipse project files 2013-03-15 22:02:00 +00:00
Hieu Hoang
974bdd979b memory leak 2013-03-15 14:19:36 +00:00
Hieu Hoang
9f33f5ba7e load scfg on-disk pt 2013-02-25 14:19:48 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00
Hieu Hoang
56506281c5 move class PointerState into its own file 2013-02-21 14:48:23 +00:00
Hieu Hoang
ce26defbf7 move class LanguageModelChartState into its own file 2013-02-21 14:29:51 +00:00
Hieu Hoang
28d189ffe6 delete Useable() 2013-02-21 13:21:03 +00:00
Hieu Hoang
8e6c65d43b delete InitializeBeforeSentenceProcessing() and CleanUpAfterSentenceProcessing() 2013-02-21 13:01:36 +00:00
Hieu Hoang
eca3661de3 rename a variable and function 2013-02-21 11:30:54 +00:00
Hieu Hoang
a0927b98e6 delete class LMRefCount. Merge LM and LM implementation back together again 2013-02-20 23:36:04 +00:00
Hieu Hoang
ab44825f29 delete GetLMType() 2013-02-20 23:02:09 +00:00
Hieu Hoang
ab56be4ee6 delete Duplicate() 2013-02-20 22:52:47 +00:00