Commit Graph

51 Commits

Author SHA1 Message Date
Hieu Hoang
5e355c1595 move lookup of all subphrases into PhraseDictionary class 2013-07-03 19:07:36 +01:00
Hieu Hoang
ac8d10af38 move lookup of all subphrases into PhraseDictionary class 2013-07-03 16:57:23 +01:00
Hieu Hoang
d68277d369 redo parsing of feature function parameters 2013-06-20 13:25:02 +01:00
Hieu Hoang
dc33fa3d3d redo parsing of feature function parameters 2013-06-20 12:50:41 +01:00
Hieu Hoang
c2f4c48758 clean up SetParameter() 2013-06-19 00:24:21 +01:00
Hieu Hoang
e51c4feb6b push calling of OnlyTheseFactors() to individual PT implementations, as needed 2013-06-17 18:31:06 +01:00
Hieu Hoang
f7371cf53d calculate m_featuresToApply in Load() for PhraseDictionary. Since every phrase dictionary now has to implement it, make Load() for PhraseDictionary abstract 2013-06-14 18:34:47 +01:00
Hieu Hoang
5becd868a9 delete misc unused variables from PhraseDictionary 2013-06-11 16:31:43 +01:00
Hieu Hoang
b4ad093334 refactor parsing of feature functiona args 2013-06-11 00:05:12 +01:00
Hieu Hoang
efa42b451c refactor parsing of feature functiona args 2013-06-10 21:24:31 +01:00
Hieu Hoang
abe6bb7c22 refactor parsing of feature functiona args 2013-06-10 18:11:55 +01:00
Hieu Hoang
96d116dba0 refactor parsing of feature functiona args 2013-06-10 16:29:07 +01:00
Hieu Hoang
e291c5f4a4 implement feature override as a run-time override of specific argument of a feature function. Only implemented table-limit for far 2013-06-07 17:32:01 +01:00
Hieu Hoang
df4b8e5828 m_numInputScores deleted from PhraseDictionary. 2013-06-06 18:54:44 +01:00
Hieu Hoang
117eb76b0a figure out which feature function to apply at which decode step. Book-keeping 2013-05-30 18:34:10 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
031cbdf7cd move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number 2013-05-20 19:57:46 +01:00
Hieu Hoang
34df0011a9 change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary 2013-05-14 12:19:55 +01:00
Hieu Hoang
805c5c5be9 port PhraseDictionaryMultiModel to new format 2013-05-10 15:13:03 +01:00
Hieu Hoang
ce80626c9a remove SparsePhraseDictionaryFeature 2013-05-01 13:17:09 +01:00
Hieu Hoang
b448c6285a make scfg work with factored input. Strip factors from source that are not part of phrase-table input factors 2013-04-26 12:20:49 +01:00
Hieu Hoang
2c26ad133e error parsing factors. And eclipse project files 2013-03-16 16:41:38 +00:00
Hieu Hoang
d0e2e417aa merging PhraseDictionaryMemory and PhraseDictionarySCFG. target phrase score not the same 2013-03-08 16:33:36 +00:00
Hieu Hoang
30ef335226 sparse pt features works with new pt format 2013-02-25 16:52:02 +00:00
Hieu Hoang
194adf8130 change format for phrase model 2013-02-22 19:17:57 +00:00
Hieu Hoang
f8a554ff22 delete PTLOAD_TIME 2013-02-21 22:55:41 +00:00
Hieu Hoang
86b848ef24 set m_useThreadSafePhraseDictionary 2013-02-21 18:06:03 +00:00
Hieu Hoang
e0746cd525 throw exception if unknown argument 2013-02-19 17:31:11 +00:00
Hieu Hoang
9d0c4801d5 name-value pairs for LM arguments 2013-02-04 23:10:12 +00:00
Hieu Hoang
22ee96d76b use new constructor for PhraseDictionaryFeature 2013-02-04 12:07:21 +00:00
Hieu Hoang
95c602fb11 use new constructor 2013-02-04 01:09:15 +00:00
Hieu Hoang
63cd5d4faf use new constructor 2013-02-03 23:55:05 +00:00
Hieu Hoang
ed4921c0c9 delete variable weight 2013-02-03 23:30:36 +00:00
Hieu Hoang
55dd8f1fcf delete variable m_dictIndex 2013-02-03 23:04:52 +00:00
Hieu Hoang
530e859697 tokenize line now moved into base class ScoreProducer 2013-02-01 20:23:36 +00:00
Hieu Hoang
6ed71fc73c separate out PhraseDictionaryFeature from SparsePhraseDictionaryFeature 2013-02-01 16:59:30 +00:00
Hieu Hoang
551d97344c refactor PhraseDictionaryFeature 2013-02-01 15:50:57 +00:00
hieu
01243e415a Merge branch 'master' into weight-new 2013-01-03 17:17:35 +00:00
hieu
15c776eda4 delete check and exit of Suffix Array phrase table implementation erroneously checked in 2013-01-03 14:35:39 +00:00
Hieu Hoang
8a8825d740 delete PhraseDictionary::InitDictionary() 2012-12-27 12:26:27 +00:00
Hieu Hoang
0df397065d clean up InitializeBeforeSentenceProcessing() 2012-12-24 16:52:40 +00:00
Hieu Hoang
c3fe79564c clean up CleanUpAfterSentenceProcessing() 2012-12-24 15:17:13 +00:00
Hieu Hoang
efbc8bb6c4 move language model from TranslationSystem back to StaticData 2012-12-20 16:38:15 +00:00
Hieu Hoang
5d9980af91 move WordPenalty to staticData 2012-12-19 15:38:57 +00:00
Hieu Hoang
f9e21799ed get rid of all occurance of GetNumInputScores() from feature functions. 2012-12-07 16:25:55 +00:00
Hieu Hoang
9fe742ce52 get rid function GetScoreProducerWeightShortName(). Fails 1 regression test 2012-12-04 17:09:23 +00:00
Hieu Hoang
33105a7ba7 get rid of int argument from GetScoreProducerWeightShortName() 2012-12-04 13:08:00 +00:00
Hieu Hoang
d4ead15066 fuzzy match phrase-table is multi-threaded 2012-11-29 15:27:38 +00:00
Hieu Hoang
9aad7c65c9 move CompactPt to TranslationModel/ 2012-11-27 18:04:01 +00:00
Hieu Hoang
1aae9aa23c move RuleTable to TranslationModel/ 2012-11-27 16:57:23 +00:00