161 Commits

Author	SHA1	Message	Date
Hieu Hoang	352e36334a	Merge branch 'master' of github.com:moses-smt/mosesdecoder	2013-06-26 11:54:12 +01:00
Hieu Hoang	ea0c7b63e7	fix argument parsing in PhraseDictionaryALSuffixArray	2013-06-24 16:10:22 +01:00
Kenneth Heafield	718e90d006	Missing header	2013-06-21 09:38:45 -04:00
Hieu Hoang	a69ad79e9c	Merge branch 'master' of github.com:moses-smt/mosesdecoder	2013-06-21 14:38:14 +01:00
Hieu Hoang	3d790b7226	minor cleanup	2013-06-20 17:15:54 +01:00
Hieu Hoang	24d2edd790	redo parsing of feature function parameters	2013-06-20 13:06:03 +01:00
Hieu Hoang	dc33fa3d3d	redo parsing of feature function parameters	2013-06-20 12:50:41 +01:00
Hieu Hoang	f7371cf53d	calculate m_featuresToApply in Load() for PhraseDictionary. Since every phrase dictionary now has to implement it, make Load() for PhraseDictionary abstract	2013-06-14 18:34:47 +01:00
Hieu Hoang	61e2b7a24f	refactor parsing of feature functiona args	2013-06-11 01:46:04 +01:00
Hieu Hoang	abe6bb7c22	refactor parsing of feature functiona args	2013-06-10 18:11:55 +01:00
Hieu Hoang	21ff6d4831	beautify	2013-06-03 12:33:18 +01:00
Hieu Hoang	3b76143072	refactor loading in class PhraseDictionaryFuzzyMatch	2013-05-31 23:39:19 +01:00
Hieu Hoang	eaf53769ad	consistent Load() for all feature functions. Can be used not to load if doing --show-weights	2013-05-31 20:21:02 +01:00
Hieu Hoang	117eb76b0a	figure out which feature function to apply at which decode step. Book-keeping	2013-05-30 18:34:10 +01:00
Hieu Hoang	6249432407	beautify	2013-05-29 18:16:15 +01:00
Hieu Hoang	66afd6611b	parse scores correctly. Assume dense features, always in the same order	2013-05-28 15:54:11 +01:00
Hieu Hoang	ed220e91a9	debug PhraseDictionaryALSuffixArray for Wilker. Sparse feature score to do	2013-05-28 15:38:36 +01:00
Hieu Hoang	0580e2bd11	delete create-ini	2013-05-28 13:11:37 +01:00
Hieu Hoang	036ea4ee29	delete sourcePhrase variable in TargetPhrase class	2013-05-28 11:38:18 +01:00
Hieu Hoang	ae82d02a05	delete sourcePhrase variable in TargetPhrase class	2013-05-28 00:41:25 +01:00
Hieu Hoang	e8dadb58ce	split classes in DummyScoreProducers into separate files	2013-05-25 00:57:37 +01:00
Hieu Hoang	a80d838b0f	move feature functions into moses/FF	2013-05-24 18:02:49 +01:00
Hieu Hoang	6c322ba05e	move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory	2013-05-24 16:33:30 +01:00
Hieu Hoang	4a280c8ca7	move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory	2013-05-24 16:23:31 +01:00
Hieu Hoang	ca8007be12	leak	2013-05-23 15:29:25 +01:00
Hieu Hoang	b10ecf2b44	make each node in trie a pointer. No possibility that the node is delete during build of the trie	2013-05-23 12:50:57 +01:00
Hieu Hoang	6480805635	technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind	2013-05-22 17:32:06 +01:00
Hieu Hoang	bfe321a068	change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie	2013-05-22 15:00:32 +01:00
Hieu Hoang	541bf99b9b	Make Phrase::CreateFromString() more efficient	2013-05-22 14:41:28 +01:00
Hieu Hoang	bce3b36170	Make Phrase::CreateFromString() more efficient	2013-05-22 12:28:32 +01:00
Hieu Hoang	f4a75b30f7	Make lhsTarget a pointer	2013-05-22 11:22:17 +01:00
Hieu Hoang	2f38746f6a	delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function	2013-05-21 14:00:28 +01:00
Hieu Hoang	81003b9464	delete references to WordPenaltyProducer	2013-05-21 13:44:19 +01:00
Hieu Hoang	195186b335	delete references to WordPenaltyProducer	2013-05-21 13:39:31 +01:00
Hieu Hoang	f4cf5f152b	delete references to LMList	2013-05-21 13:00:26 +01:00
Hieu Hoang	42ddc084b4	delete references to LMList	2013-05-21 12:47:26 +01:00
Hieu Hoang	499487fb98	get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly	2013-05-13 15:36:09 +01:00
Hieu Hoang	fdcfe95574	start framework for evaluating target phrase score	2013-05-02 17:19:45 +01:00
Hieu Hoang	46b70fe89a	start framework for evaluating target phrase score	2013-05-02 17:07:03 +01:00
Hieu Hoang	47465f8afb	start framework for evaluating target phrase score	2013-05-02 14:55:26 +01:00
Hieu Hoang	2b93917a80	delete argument report-sparse-features	2013-05-01 12:40:59 +01:00
Hieu Hoang	26a4aa8d18	enable sparse feature in phrase table	2013-04-30 17:27:35 +01:00
Hieu Hoang	83494418e2	delete PhraseDictionaryMemory. Fix word penalty in compact phrase table	2013-04-26 15:55:32 +01:00
Hieu Hoang	51d34f2f96	delete Phrase::CreateFromStringNewFormat()	2013-03-08 22:04:28 +00:00
Hieu Hoang	d015ef2e62	merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat()	2013-03-08 17:56:39 +00:00
Hieu Hoang	d0e2e417aa	merging PhraseDictionaryMemory and PhraseDictionarySCFG. target phrase score not the same	2013-03-08 16:33:36 +00:00
Hieu Hoang	66ad6f32ce	start merging PhraseDictionaryMemory and PhraseDictionarySCFG	2013-03-07 19:12:49 +00:00
Hieu Hoang	1f6592aaa9	eclipse	2013-03-07 17:40:45 +00:00
Hieu Hoang	ce1d50723a	make on-disk pt threadable	2013-03-05 14:02:55 +00:00
Hieu Hoang	5344cc1a63	load PhraseDictionarySCFG	2013-02-25 14:50:33 +00:00
Hieu Hoang	c90eec946f	load scfg on-disk pt	2013-02-25 14:24:34 +00:00
Hieu Hoang	9f33f5ba7e	load scfg on-disk pt	2013-02-25 14:19:48 +00:00
Hieu Hoang	194adf8130	change format for phrase model	2013-02-22 19:17:57 +00:00
Hieu Hoang	bf58eac8bc	clean up InitializeBeforeSentenceProcessing()	2012-12-24 18:52:04 +00:00
Hieu Hoang	50f666f397	clean up CleanUpAfterSentenceProcessing()	2012-12-24 15:37:11 +00:00
Hieu Hoang	961cc53ae5	clean up CleanUpAfterSentenceProcessing()	2012-12-24 14:34:34 +00:00
Hieu Hoang	8799e721ac	move phrase tables and generation tables to staticData	2012-12-21 14:54:43 +00:00
Hieu Hoang	f212927368	get rid of all overrides for GetScoreProducerDescription(). Except SyntacticLM - not sure if it should be separated from LM or not	2012-12-07 16:05:50 +00:00
Hieu Hoang	bc1e96730d	move CKY+Parser to TranslationModel/	2012-11-27 17:23:31 +00:00
Hieu Hoang	ae8a48b022	move Score3Parser to TranslationModel/	2012-11-27 17:09:23 +00:00
Hieu Hoang	1aae9aa23c	move RuleTable to TranslationModel/	2012-11-27 16:57:23 +00:00