66 Commits

Author	SHA1	Message	Date
Hieu Hoang	abe6bb7c22	refactor parsing of feature functiona args	2013-06-10 18:11:55 +01:00
Hieu Hoang	7f1a6041ba	explicitly declare how many scores there are in language model features	2013-06-04 21:49:37 +01:00
Hieu Hoang	21ff6d4831	beautify	2013-06-03 12:33:18 +01:00
Hieu Hoang	695617d930	consistent Load() for all feature functions. Can be used not to load if doing --show-weights	2013-05-31 20:50:13 +01:00
Hieu Hoang	eaf53769ad	consistent Load() for all feature functions. Can be used not to load if doing --show-weights	2013-05-31 20:21:02 +01:00
Hieu Hoang	bc0fdfbd79	delete LM:Useable(). Superseded by IsUseable() for all feature functions	2013-05-31 00:11:38 +01:00
Hieu Hoang	83c4477841	figure out which feature function to apply at which decode step. Book-keeping	2013-05-30 12:41:08 +01:00
Hieu Hoang	6249432407	beautify	2013-05-29 18:16:15 +01:00
Hieu Hoang	b5bb500773	move GetFirstLM() as static method of LanguageModel	2013-05-28 17:35:06 +01:00
Hieu Hoang	537e9373f8	minor warnings	2013-05-28 11:57:13 +01:00
Hieu Hoang	d647dd8aa3	delete sourcePhrase variable in TargetPhrase class	2013-05-28 10:51:28 +01:00
Hieu Hoang	75a1849bcf	split classes in FeatureFunction files	2013-05-24 19:11:15 +01:00
Hieu Hoang	a80d838b0f	move feature functions into moses/FF	2013-05-24 18:02:49 +01:00
Hieu Hoang	41da563645	port SRILM to new weights format	2013-05-19 12:44:45 +01:00
Hieu Hoang	47465f8afb	start framework for evaluating target phrase score	2013-05-02 14:55:26 +01:00
Hieu Hoang	c99e9f8c90	start framework for evaluating target phrase score	2013-05-02 12:15:26 +01:00
Hieu Hoang	4894df6494	merge	2013-04-29 19:04:00 +01:00
Hieu Hoang	ce95c117f6	merge	2013-04-29 18:46:48 +01:00
Lane Schwartz	62e1bf05d6	Added slightly more unit test coverage for backward LM.	2013-04-29 09:18:46 -04:00
Lane Schwartz	afa270a2e6	Initial unit test for BackwardLanguageModel Evaluate method	2013-04-29 09:18:46 -04:00
Lane Schwartz	e5de2e5917	Checking in changes. ... This currently doesn't compile. Need to debug why.	2013-04-29 09:18:46 -04:00
Lane Schwartz	4a44c4682b	Work on BackwardLM unit testing	2013-04-29 09:18:46 -04:00
Lane Schwartz	aacc936204	Adding unit tests to Backward LM	2013-04-29 09:18:46 -04:00
Lane Schwartz	95e3a37469	Added CalcScore to BackwardLanguageModel	2013-04-29 09:18:45 -04:00
Lane Schwartz	d340218fd4	BackwardLM now can calculate its empty state	2013-04-29 09:18:45 -04:00
Lane Schwartz	8459a86137	Refactoring code from Ken.cpp into Ken.h ... in preparation for implemenation of backward language model from Xiong et al (2011)	2013-04-29 09:18:45 -04:00
Hieu Hoang	f5d3f16fab	rescale LM score for chart decoding by KenLM. All regression tests passes	2013-04-29 13:01:26 +01:00
Hieu Hoang	aa9689d12b	rescale LM score for chart decoding	2013-04-26 19:39:29 +01:00
Kenneth Heafield	f1d3663810	Back FactorCollection with a memory pool. Less memory for large vocabularies.	2013-04-25 19:42:30 +01:00
Hieu Hoang	68b64974c4	runtime error using name args with language models	2013-03-19 12:19:39 +00:00
Hieu Hoang	b4ab054453	merge error	2013-03-16 16:18:51 +00:00
Hieu Hoang	7888c7ba23	eclipse project files	2013-03-15 22:02:00 +00:00
Hieu Hoang	974bdd979b	memory leak	2013-03-15 14:19:36 +00:00
Hieu Hoang	9f33f5ba7e	load scfg on-disk pt	2013-02-25 14:19:48 +00:00
Hieu Hoang	f8a554ff22	delete PTLOAD_TIME	2013-02-21 22:55:41 +00:00
Hieu Hoang	56506281c5	move class PointerState into its own file	2013-02-21 14:48:23 +00:00
Hieu Hoang	ce26defbf7	move class LanguageModelChartState into its own file	2013-02-21 14:29:51 +00:00
Hieu Hoang	28d189ffe6	delete Useable()	2013-02-21 13:21:03 +00:00
Hieu Hoang	8e6c65d43b	delete InitializeBeforeSentenceProcessing() and CleanUpAfterSentenceProcessing()	2013-02-21 13:01:36 +00:00
Hieu Hoang	eca3661de3	rename a variable and function	2013-02-21 11:30:54 +00:00
Hieu Hoang	a0927b98e6	delete class LMRefCount. Merge LM and LM implementation back together again	2013-02-20 23:36:04 +00:00
Hieu Hoang	ab44825f29	delete GetLMType()	2013-02-20 23:02:09 +00:00
Hieu Hoang	ab56be4ee6	delete Duplicate()	2013-02-20 22:52:47 +00:00
Hieu Hoang	1a1634a391	make LanguageModelImplementation have new format constructor	2013-02-20 22:44:11 +00:00
Hieu Hoang	165ed39296	delete LanguageModelPointerState	2013-02-20 22:09:00 +00:00
Hieu Hoang	e0746cd525	throw exception if unknown argument	2013-02-19 17:31:11 +00:00
Hieu Hoang	f7e3f20013	each language model should have separate description, rather than just 'LM'	2013-02-06 20:05:00 +00:00
Hieu Hoang	9d0c4801d5	name-value pairs for LM arguments	2013-02-04 23:10:12 +00:00
Hieu Hoang	2573d0a122	delete LM/Factory.*	2013-02-01 21:01:44 +00:00
Hieu Hoang	530e859697	tokenize line now moved into base class ScoreProducer	2013-02-01 20:23:36 +00:00