Commit Graph

10336 Commits

Author SHA1 Message Date
Hieu Hoang
def03041b7 make evaluation of TargetWordInsertionFeature more efficient. It's a normal stateless feature, was evaluating at every hypothesis expansion 2013-05-23 18:49:31 +01:00
Hieu Hoang
02b6977395 add plumbing for evaluating features that need source sentence 2013-05-23 18:12:08 +01:00
Hieu Hoang
ca8007be12 leak 2013-05-23 15:29:25 +01:00
Hieu Hoang
234ebf2ea5 segfault in edge case where target translation has no words 2013-05-23 14:23:31 +01:00
Hieu Hoang
b10ecf2b44 make each node in trie a pointer. No possibility that the node is delete during build of the trie 2013-05-23 12:50:57 +01:00
Hieu Hoang
6480805635 technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind 2013-05-22 17:32:06 +01:00
Hieu Hoang
5fb63e55da technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind 2013-05-22 16:19:31 +01:00
Ian Johnson
dd57b88e36 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-22 15:39:48 +01:00
Ian Johnson
c839cf48c5 Udpated PCL 2013-05-22 15:39:36 +01:00
Hieu Hoang
87a759924b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-22 15:00:52 +01:00
Hieu Hoang
bfe321a068 change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie 2013-05-22 15:00:32 +01:00
Hieu Hoang
541bf99b9b Make Phrase::CreateFromString() more efficient 2013-05-22 14:41:28 +01:00
Hieu Hoang
b1edb968a3 Make Phrase::CreateFromString() more efficient 2013-05-22 14:16:44 +01:00
Ian Johnson
d9e3223e7c Re-wrote the README 2013-05-22 13:29:48 +01:00
Hieu Hoang
bce3b36170 Make Phrase::CreateFromString() more efficient 2013-05-22 12:28:32 +01:00
Hieu Hoang
369e3411f9 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-22 12:12:08 +01:00
Ian Johnson
10820e5bfd Added Makefiles 2013-05-22 12:11:41 +01:00
Hieu Hoang
112bcdc925 Make Phrase::CreateFromString() more efficient 2013-05-22 12:03:00 +01:00
Hieu Hoang
f4a75b30f7 Make lhsTarget a pointer 2013-05-22 11:22:17 +01:00
Hieu Hoang
53d625de5b Get ready to make lhsTarget a pointer 2013-05-22 10:57:19 +01:00
Hieu Hoang
4fdda2e2d9 Get ready to make lhsTarget a pointer 2013-05-22 10:40:12 +01:00
Hieu Hoang
38c4b3695f delete TargetPhrase::MutableTargetLHS(). Get ready to make lhsTarget a pointer 2013-05-22 10:26:06 +01:00
Ian Johnson
166eb7d0e0 Added PCL based arrow pipelining 2013-05-22 10:25:25 +01:00
Hieu Hoang
2f38746f6a delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function 2013-05-21 14:00:28 +01:00
Hieu Hoang
7dc177514d delete references to WordPenaltyProducer 2013-05-21 13:50:18 +01:00
Hieu Hoang
81003b9464 delete references to WordPenaltyProducer 2013-05-21 13:44:19 +01:00
Hieu Hoang
195186b335 delete references to WordPenaltyProducer 2013-05-21 13:39:31 +01:00
Hieu Hoang
0e1c246010 delete references to WordPenaltyProducer 2013-05-21 13:22:04 +01:00
Hieu Hoang
fca7e0b530 delete references to MetaFeatureProducer 2013-05-21 13:12:29 +01:00
Hieu Hoang
f4cf5f152b delete references to LMList 2013-05-21 13:00:26 +01:00
Hieu Hoang
42ddc084b4 delete references to LMList 2013-05-21 12:47:26 +01:00
Hieu Hoang
70873c3b8d delete references to LMList 2013-05-21 12:33:51 +01:00
Hieu Hoang
ff880ec6f1 delete references to LMList 2013-05-21 12:27:13 +01:00
Hieu Hoang
031cbdf7cd move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number 2013-05-20 19:57:46 +01:00
Hieu Hoang
3e7f412ae9 make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it 2013-05-20 17:01:19 +01:00
Hieu Hoang
a635518346 cannot negate size_t. Only a problem on 32-bit OSes 2013-05-20 13:02:16 +01:00
Hieu Hoang
aa938fd4ad delete unused Evaluate() method in WordPnealtyFeature 2013-05-20 11:53:59 +01:00
Hieu Hoang
e13884dbc4 rollback change 'cos Ken is hassling me 2013-05-19 21:13:00 +01:00
Hieu Hoang
33588b702c compile error on mac osx. Just #ifdef for now, but should use Boost or something to make it cross-platform. It keeps happening 2013-05-19 19:16:52 +01:00
Kenneth Heafield
1c81c5582f Make a slow code path for std::set FindStringPiece. I had fixed sparse features to use hash tables. But Hieu reverted this and kludged
FindStringPiece to be slow.  This change returns my code to being fast and leaves the performance problem to Hieu/Eva.
2013-05-19 10:22:50 -04:00
Kenneth Heafield
50652382e9 KenLM 10ddf7d923355b35a7de9a5219673eca9e18be98 except Hieu's slow string_piece_hash 2013-05-19 10:12:06 -04:00
Hieu Hoang
41da563645 port SRILM to new weights format 2013-05-19 12:44:45 +01:00
phikoehn
542cd72c63 moved config creation back into train-model.perl 2013-05-19 03:28:02 +01:00
Hieu Hoang
668bda8623 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2013-05-17 18:24:38 +01:00
Hieu Hoang
e800ee999b put back #ifdef LM_IRST 2013-05-17 18:24:24 +01:00
Hieu Hoang
0596ba4245 carry [weight-file] from tuned ini 2013-05-17 18:23:55 +01:00
Hieu Hoang
11632e298e add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step 2013-05-17 16:13:24 +01:00
Hieu Hoang
42c292765a add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step 2013-05-17 13:28:21 +01:00
phikoehn
4cdffc8a89 fixes for sparse feature handling 2013-05-17 08:37:29 +01:00
phikoehn
13991fc88f added specification to example config files for fast align 2013-05-17 06:42:54 +01:00