Commit Graph

2503 Commits

Author SHA1 Message Date
Hieu Hoang
8c17f65f84 optimise evalution with SourceWordDeletionFeature 2013-05-24 11:35:25 +01:00
Hieu Hoang
5d429abc6e optimise evalution with SourceWordDeletionFeature 2013-05-24 11:33:24 +01:00
Hieu Hoang
e8d71da9dd Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-24 10:16:12 +01:00
Hieu Hoang
ccbb916b5f segfault on mac osx. 2013-05-24 00:21:16 +01:00
Hieu Hoang
4466d33df6 delete unused function 2013-05-23 18:55:59 +01:00
Hieu Hoang
def03041b7 make evaluation of TargetWordInsertionFeature more efficient. It's a normal stateless feature, was evaluating at every hypothesis expansion 2013-05-23 18:49:31 +01:00
Hieu Hoang
02b6977395 add plumbing for evaluating features that need source sentence 2013-05-23 18:12:08 +01:00
Hieu Hoang
ca8007be12 leak 2013-05-23 15:29:25 +01:00
Hieu Hoang
234ebf2ea5 segfault in edge case where target translation has no words 2013-05-23 14:23:31 +01:00
Hieu Hoang
b10ecf2b44 make each node in trie a pointer. No possibility that the node is delete during build of the trie 2013-05-23 12:50:57 +01:00
Hieu Hoang
6480805635 technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind 2013-05-22 17:32:06 +01:00
Hieu Hoang
5fb63e55da technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind 2013-05-22 16:19:31 +01:00
Hieu Hoang
bfe321a068 change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie 2013-05-22 15:00:32 +01:00
Hieu Hoang
541bf99b9b Make Phrase::CreateFromString() more efficient 2013-05-22 14:41:28 +01:00
Hieu Hoang
b1edb968a3 Make Phrase::CreateFromString() more efficient 2013-05-22 14:16:44 +01:00
Hieu Hoang
bce3b36170 Make Phrase::CreateFromString() more efficient 2013-05-22 12:28:32 +01:00
Hieu Hoang
112bcdc925 Make Phrase::CreateFromString() more efficient 2013-05-22 12:03:00 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Hieu Hoang
53d625de5b Get ready to make lhsTarget a pointer 2013-05-22 10:57:19 +01:00
Hieu Hoang
4fdda2e2d9 Get ready to make lhsTarget a pointer 2013-05-22 10:40:12 +01:00
Hieu Hoang
38c4b3695f delete TargetPhrase::MutableTargetLHS(). Get ready to make lhsTarget a pointer 2013-05-22 10:26:06 +01:00
Hieu Hoang
2f38746f6a delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function 2013-05-21 14:00:28 +01:00
Hieu Hoang
7dc177514d delete references to WordPenaltyProducer 2013-05-21 13:50:18 +01:00
Hieu Hoang
81003b9464 delete references to WordPenaltyProducer 2013-05-21 13:44:19 +01:00
Hieu Hoang
195186b335 delete references to WordPenaltyProducer 2013-05-21 13:39:31 +01:00
Hieu Hoang
0e1c246010 delete references to WordPenaltyProducer 2013-05-21 13:22:04 +01:00
Hieu Hoang
fca7e0b530 delete references to MetaFeatureProducer 2013-05-21 13:12:29 +01:00
Hieu Hoang
f4cf5f152b delete references to LMList 2013-05-21 13:00:26 +01:00
Hieu Hoang
42ddc084b4 delete references to LMList 2013-05-21 12:47:26 +01:00
Hieu Hoang
70873c3b8d delete references to LMList 2013-05-21 12:33:51 +01:00
Hieu Hoang
ff880ec6f1 delete references to LMList 2013-05-21 12:27:13 +01:00
Hieu Hoang
031cbdf7cd move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number 2013-05-20 19:57:46 +01:00
Hieu Hoang
3e7f412ae9 make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it 2013-05-20 17:01:19 +01:00
Hieu Hoang
a635518346 cannot negate size_t. Only a problem on 32-bit OSes 2013-05-20 13:02:16 +01:00
Hieu Hoang
aa938fd4ad delete unused Evaluate() method in WordPnealtyFeature 2013-05-20 11:53:59 +01:00
Hieu Hoang
41da563645 port SRILM to new weights format 2013-05-19 12:44:45 +01:00
phikoehn
542cd72c63 moved config creation back into train-model.perl 2013-05-19 03:28:02 +01:00
Hieu Hoang
e800ee999b put back #ifdef LM_IRST 2013-05-17 18:24:24 +01:00
Hieu Hoang
7b9141d70d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-16 22:51:08 +01:00
Hieu Hoang
03d5c670e7 don't load file if none is specified 2013-05-16 22:50:13 +01:00
Hieu Hoang
64b4a8805a remove all mention of MetaFeature 2013-05-16 19:41:35 +01:00
Hieu Hoang
ab51ccff6d assert error when outputting pure sparse feature by ShowWeights() 2013-05-16 19:12:54 +01:00
Hieu Hoang
f04ec4c56d 1. remove all code for MetaFeature from mira.
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 19:05:08 +01:00
Rico Sennrich
5fa1752018 multimodel(counts): allow different features to have separate interpolation weights. 2013-05-16 14:11:03 +02:00
Rico Sennrich
876de13eba restore support for multimodel(counts) in moses server:
set sentence-level weights and optimize weights
2013-05-16 13:40:17 +02:00
Hieu Hoang
3876c47d1d port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-15 15:52:08 +01:00
Hieu Hoang
b2488f83c3 port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-15 14:34:31 +01:00
Hieu Hoang
02099a9d73 add test for sparse feature PhraseLengthFeature 2013-05-15 12:20:44 +01:00
Hieu Hoang
0f75865faa 1. Get rid of GetSparseFeatureReporting(). Always report detailed sparse features, if they exist.
2. Name sparse features properly in class WordTranslationFeature
2013-05-15 11:37:21 +01:00
Hieu Hoang
81ffe84dbc port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test 2013-05-14 17:35:22 +01:00