Commit Graph

58 Commits

Author SHA1 Message Date
Hieu Hoang
ea0c7b63e7 fix argument parsing in PhraseDictionaryALSuffixArray 2013-06-24 16:10:22 +01:00
Kenneth Heafield
718e90d006 Missing header 2013-06-21 09:38:45 -04:00
Hieu Hoang
24d2edd790 redo parsing of feature function parameters 2013-06-20 13:06:03 +01:00
Hieu Hoang
dc33fa3d3d redo parsing of feature function parameters 2013-06-20 12:50:41 +01:00
Hieu Hoang
f7371cf53d calculate m_featuresToApply in Load() for PhraseDictionary. Since every phrase dictionary now has to implement it, make Load() for PhraseDictionary abstract 2013-06-14 18:34:47 +01:00
Hieu Hoang
61e2b7a24f refactor parsing of feature functiona args 2013-06-11 01:46:04 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
21ff6d4831 beautify 2013-06-03 12:33:18 +01:00
Hieu Hoang
3b76143072 refactor loading in class PhraseDictionaryFuzzyMatch 2013-05-31 23:39:19 +01:00
Hieu Hoang
eaf53769ad consistent Load() for all feature functions. Can be used not to load if doing --show-weights 2013-05-31 20:21:02 +01:00
Hieu Hoang
117eb76b0a figure out which feature function to apply at which decode step. Book-keeping 2013-05-30 18:34:10 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
66afd6611b parse scores correctly. Assume dense features, always in the same order 2013-05-28 15:54:11 +01:00
Hieu Hoang
ed220e91a9 debug PhraseDictionaryALSuffixArray for Wilker. Sparse feature score to do 2013-05-28 15:38:36 +01:00
Hieu Hoang
0580e2bd11 delete create-ini 2013-05-28 13:11:37 +01:00
Hieu Hoang
036ea4ee29 delete sourcePhrase variable in TargetPhrase class 2013-05-28 11:38:18 +01:00
Hieu Hoang
ae82d02a05 delete sourcePhrase variable in TargetPhrase class 2013-05-28 00:41:25 +01:00
Hieu Hoang
e8dadb58ce split classes in DummyScoreProducers into separate files 2013-05-25 00:57:37 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
6c322ba05e move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:33:30 +01:00
Hieu Hoang
4a280c8ca7 move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory 2013-05-24 16:23:31 +01:00
Hieu Hoang
ca8007be12 leak 2013-05-23 15:29:25 +01:00
Hieu Hoang
b10ecf2b44 make each node in trie a pointer. No possibility that the node is delete during build of the trie 2013-05-23 12:50:57 +01:00
Hieu Hoang
6480805635 technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind 2013-05-22 17:32:06 +01:00
Hieu Hoang
bfe321a068 change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie 2013-05-22 15:00:32 +01:00
Hieu Hoang
541bf99b9b Make Phrase::CreateFromString() more efficient 2013-05-22 14:41:28 +01:00
Hieu Hoang
bce3b36170 Make Phrase::CreateFromString() more efficient 2013-05-22 12:28:32 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Hieu Hoang
2f38746f6a delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function 2013-05-21 14:00:28 +01:00
Hieu Hoang
81003b9464 delete references to WordPenaltyProducer 2013-05-21 13:44:19 +01:00
Hieu Hoang
195186b335 delete references to WordPenaltyProducer 2013-05-21 13:39:31 +01:00
Hieu Hoang
f4cf5f152b delete references to LMList 2013-05-21 13:00:26 +01:00
Hieu Hoang
42ddc084b4 delete references to LMList 2013-05-21 12:47:26 +01:00
Hieu Hoang
499487fb98 get rid of TargetPhrase::SetScore. Expose ScorerBreakdown object so they can be set directly 2013-05-13 15:36:09 +01:00
Hieu Hoang
fdcfe95574 start framework for evaluating target phrase score 2013-05-02 17:19:45 +01:00
Hieu Hoang
46b70fe89a start framework for evaluating target phrase score 2013-05-02 17:07:03 +01:00
Hieu Hoang
47465f8afb start framework for evaluating target phrase score 2013-05-02 14:55:26 +01:00
Hieu Hoang
2b93917a80 delete argument report-sparse-features 2013-05-01 12:40:59 +01:00
Hieu Hoang
26a4aa8d18 enable sparse feature in phrase table 2013-04-30 17:27:35 +01:00
Hieu Hoang
83494418e2 delete PhraseDictionaryMemory. Fix word penalty in compact phrase table 2013-04-26 15:55:32 +01:00
Hieu Hoang
51d34f2f96 delete Phrase::CreateFromStringNewFormat() 2013-03-08 22:04:28 +00:00
Hieu Hoang
d015ef2e62 merge Phrase::CreateFromString() and Phrase::CreateFromStringNewFormat() 2013-03-08 17:56:39 +00:00
Hieu Hoang
d0e2e417aa merging PhraseDictionaryMemory and PhraseDictionarySCFG. target phrase score not the same 2013-03-08 16:33:36 +00:00
Hieu Hoang
66ad6f32ce start merging PhraseDictionaryMemory and PhraseDictionarySCFG 2013-03-07 19:12:49 +00:00
Hieu Hoang
1f6592aaa9 eclipse 2013-03-07 17:40:45 +00:00
Hieu Hoang
ce1d50723a make on-disk pt threadable 2013-03-05 14:02:55 +00:00
Hieu Hoang
5344cc1a63 load PhraseDictionarySCFG 2013-02-25 14:50:33 +00:00
Hieu Hoang
c90eec946f load scfg on-disk pt 2013-02-25 14:24:34 +00:00
Hieu Hoang
9f33f5ba7e load scfg on-disk pt 2013-02-25 14:19:48 +00:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00