Kenneth Heafield
|
241432b47a
|
Missing header
|
2013-06-05 09:51:00 +01:00 |
|
Hieu Hoang
|
0c48e687d1
|
delete information on input scores from StaticData
|
2013-06-05 01:41:52 +01:00 |
|
Hieu Hoang
|
e682578a42
|
update confusion network to query InputFeature for paramters, rather than StaticData
|
2013-06-05 01:13:25 +01:00 |
|
Hieu Hoang
|
cc0f00049e
|
update confusion network to query InputFeature for paramters, rather than StaticData
|
2013-06-05 00:50:24 +01:00 |
|
Hieu Hoang
|
fc7e4f4550
|
minor cleanup of InputFeature
|
2013-06-04 22:09:21 +01:00 |
|
Hieu Hoang
|
7f1a6041ba
|
explicitly declare how many scores there are in language model features
|
2013-06-04 21:49:37 +01:00 |
|
Hieu Hoang
|
4232188fe4
|
new function Parameter::Save() to serialise ini file parameters
|
2013-06-04 17:01:10 +01:00 |
|
Hieu Hoang
|
21ff6d4831
|
beautify
|
2013-06-03 12:33:18 +01:00 |
|
Hieu Hoang
|
3b76143072
|
refactor loading in class PhraseDictionaryFuzzyMatch
|
2013-05-31 23:39:19 +01:00 |
|
Hieu Hoang
|
7839b8f0d1
|
refactor loading in class LexicalReordering
|
2013-05-31 23:04:05 +01:00 |
|
Hieu Hoang
|
695617d930
|
consistent Load() for all feature functions. Can be used not to load if doing --show-weights
|
2013-05-31 20:50:13 +01:00 |
|
Hieu Hoang
|
eaf53769ad
|
consistent Load() for all feature functions. Can be used not to load if doing --show-weights
|
2013-05-31 20:21:02 +01:00 |
|
Hieu Hoang
|
7fc87f46a9
|
Merge branch 'master' of github.com:moses-smt/mosesdecoder
|
2013-05-31 15:07:20 +01:00 |
|
Hieu Hoang
|
173cfffaac
|
Reapply Abby Levenberg's log change @4b4aba3
|
2013-05-31 15:06:36 +01:00 |
|
Hieu Hoang
|
0db5504629
|
port PhraseDictionaryDynSuffixArray to new ini format. Scores aren't the same. Probably something to do with Abby Levenberg's log change
|
2013-05-31 15:02:34 +01:00 |
|
phikoehn
|
d1650a5aa7
|
basic support for alternate weight settings
|
2013-05-31 12:28:57 +01:00 |
|
Hieu Hoang
|
061e5b8259
|
reset list of feature function for every decode graph
|
2013-05-31 00:46:28 +01:00 |
|
Hieu Hoang
|
bc0fdfbd79
|
delete LM:Useable(). Superseded by IsUseable() for all feature functions
|
2013-05-31 00:11:38 +01:00 |
|
Hieu Hoang
|
65d2d68bc5
|
beautify
|
2013-05-31 00:00:21 +01:00 |
|
Hieu Hoang
|
d9bd7dc818
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 23:59:29 +01:00 |
|
Hieu Hoang
|
9c81696143
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 22:13:57 +01:00 |
|
Hieu Hoang
|
f9d6528088
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 21:12:36 +01:00 |
|
Hieu Hoang
|
7279164c8a
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 20:04:48 +01:00 |
|
Hieu Hoang
|
47902053b5
|
function to merge feature scores. ie. not add them together.
|
2013-05-30 19:20:54 +01:00 |
|
Hieu Hoang
|
117eb76b0a
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 18:34:10 +01:00 |
|
Hieu Hoang
|
f83622b0b7
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 17:16:10 +01:00 |
|
Hieu Hoang
|
b1993f6171
|
beautify
|
2013-05-30 12:51:40 +01:00 |
|
Hieu Hoang
|
83c4477841
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 12:41:08 +01:00 |
|
Hieu Hoang
|
b61a57d654
|
figure out which feature function to apply at which decode step. Book-keeping
|
2013-05-30 11:25:57 +01:00 |
|
Hieu Hoang
|
84ec2043b7
|
cleanup CreateTargetPhrase()
|
2013-05-29 19:02:46 +01:00 |
|
Hieu Hoang
|
6249432407
|
beautify
|
2013-05-29 18:16:15 +01:00 |
|
Hieu Hoang
|
b5bb500773
|
move GetFirstLM() as static method of LanguageModel
|
2013-05-28 17:35:06 +01:00 |
|
Hieu Hoang
|
266a81c9cf
|
add class InputFeature. To replace 7 year old hack of using phrase table weights for input scores for confusion networks and lattice inputs
|
2013-05-28 17:25:59 +01:00 |
|
Hieu Hoang
|
66afd6611b
|
parse scores correctly. Assume dense features, always in the same order
|
2013-05-28 15:54:11 +01:00 |
|
Hieu Hoang
|
ed220e91a9
|
debug PhraseDictionaryALSuffixArray for Wilker. Sparse feature score to do
|
2013-05-28 15:38:36 +01:00 |
|
Hieu Hoang
|
0580e2bd11
|
delete create-ini
|
2013-05-28 13:11:37 +01:00 |
|
Hieu Hoang
|
537e9373f8
|
minor warnings
|
2013-05-28 11:57:13 +01:00 |
|
Hieu Hoang
|
036ea4ee29
|
delete sourcePhrase variable in TargetPhrase class
|
2013-05-28 11:38:18 +01:00 |
|
Hieu Hoang
|
5104740d1a
|
delete MutableSourcePhrase()
|
2013-05-28 11:19:47 +01:00 |
|
Hieu Hoang
|
d647dd8aa3
|
delete sourcePhrase variable in TargetPhrase class
|
2013-05-28 10:51:28 +01:00 |
|
Hieu Hoang
|
805eef6c18
|
delete sourcePhrase variable in TargetPhrase class
|
2013-05-28 01:25:27 +01:00 |
|
Hieu Hoang
|
ae82d02a05
|
delete sourcePhrase variable in TargetPhrase class
|
2013-05-28 00:41:25 +01:00 |
|
Hieu Hoang
|
87c7875391
|
delete LMList
|
2013-05-27 16:57:09 +01:00 |
|
Hieu Hoang
|
06a5c86695
|
delete LMList
|
2013-05-27 16:50:21 +01:00 |
|
Hieu Hoang
|
9006ee98be
|
delete LMList
|
2013-05-27 15:54:50 +01:00 |
|
Hieu Hoang
|
1e7a51483f
|
delete slow version of FindStringPiece() \Ken
|
2013-05-27 00:33:01 +01:00 |
|
Hieu Hoang
|
e8dadb58ce
|
split classes in DummyScoreProducers into separate files
|
2013-05-25 00:57:37 +01:00 |
|
Hieu Hoang
|
49e69f19e2
|
split classes in DummyScoreProducers into separate files
|
2013-05-25 00:25:20 +01:00 |
|
Hieu Hoang
|
c7507d678b
|
split classes in DummyScoreProducers into separate files
|
2013-05-25 00:00:13 +01:00 |
|
Hieu Hoang
|
40ae4e9522
|
split classes in DummyScoreProducers into separate files
|
2013-05-24 23:57:06 +01:00 |
|
Hieu Hoang
|
1a8dc8293c
|
split classes in FeatureFunction files
|
2013-05-24 23:18:38 +01:00 |
|
Hieu Hoang
|
75a1849bcf
|
split classes in FeatureFunction files
|
2013-05-24 19:11:15 +01:00 |
|
Hieu Hoang
|
a615421882
|
split classes in FeatureFunction files
|
2013-05-24 18:34:47 +01:00 |
|
Hieu Hoang
|
a80d838b0f
|
move feature functions into moses/FF
|
2013-05-24 18:02:49 +01:00 |
|
Hieu Hoang
|
6c322ba05e
|
move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory
|
2013-05-24 16:33:30 +01:00 |
|
Hieu Hoang
|
4a280c8ca7
|
move and rename PhraseDictionarySCFG -> PhraseDictionaryMemory
|
2013-05-24 16:23:31 +01:00 |
|
Hieu Hoang
|
d273812231
|
delete enum StatelessFeatureType. Features can be multiple types at once. Just overload the Evaluate() function you need
|
2013-05-24 16:04:38 +01:00 |
|
Hieu Hoang
|
78591e53e4
|
change Evaluate() methods from abstract to virtual, but does nothing. Each feature function can override 1 or more of them if they wish
|
2013-05-24 13:04:39 +01:00 |
|
Hieu Hoang
|
47e178b483
|
optimise evaluation with PhraseLengthFeature
|
2013-05-24 12:07:50 +01:00 |
|
Hieu Hoang
|
c72c3f6374
|
optimise evaluation with sparse features
|
2013-05-24 11:50:44 +01:00 |
|
Hieu Hoang
|
8c17f65f84
|
optimise evalution with SourceWordDeletionFeature
|
2013-05-24 11:35:25 +01:00 |
|
Hieu Hoang
|
5d429abc6e
|
optimise evalution with SourceWordDeletionFeature
|
2013-05-24 11:33:24 +01:00 |
|
Hieu Hoang
|
e8d71da9dd
|
Merge branch 'master' of github.com:moses-smt/mosesdecoder
|
2013-05-24 10:16:12 +01:00 |
|
Hieu Hoang
|
ccbb916b5f
|
segfault on mac osx.
|
2013-05-24 00:21:16 +01:00 |
|
Hieu Hoang
|
4466d33df6
|
delete unused function
|
2013-05-23 18:55:59 +01:00 |
|
Hieu Hoang
|
def03041b7
|
make evaluation of TargetWordInsertionFeature more efficient. It's a normal stateless feature, was evaluating at every hypothesis expansion
|
2013-05-23 18:49:31 +01:00 |
|
Hieu Hoang
|
02b6977395
|
add plumbing for evaluating features that need source sentence
|
2013-05-23 18:12:08 +01:00 |
|
Hieu Hoang
|
ca8007be12
|
leak
|
2013-05-23 15:29:25 +01:00 |
|
Hieu Hoang
|
234ebf2ea5
|
segfault in edge case where target translation has no words
|
2013-05-23 14:23:31 +01:00 |
|
Hieu Hoang
|
b10ecf2b44
|
make each node in trie a pointer. No possibility that the node is delete during build of the trie
|
2013-05-23 12:50:57 +01:00 |
|
Hieu Hoang
|
6480805635
|
technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind
|
2013-05-22 17:32:06 +01:00 |
|
Hieu Hoang
|
5fb63e55da
|
technical memory leak due to not cleaning up StaticData. Doesn't make much difference, but annoying messages from valgrind
|
2013-05-22 16:19:31 +01:00 |
|
Hieu Hoang
|
bfe321a068
|
change reference to sourceLHS to pointer, it can be NULL for phrase based. TODO - sourceLHS isn't being stored in the trie
|
2013-05-22 15:00:32 +01:00 |
|
Hieu Hoang
|
541bf99b9b
|
Make Phrase::CreateFromString() more efficient
|
2013-05-22 14:41:28 +01:00 |
|
Hieu Hoang
|
b1edb968a3
|
Make Phrase::CreateFromString() more efficient
|
2013-05-22 14:16:44 +01:00 |
|
Hieu Hoang
|
bce3b36170
|
Make Phrase::CreateFromString() more efficient
|
2013-05-22 12:28:32 +01:00 |
|
Hieu Hoang
|
112bcdc925
|
Make Phrase::CreateFromString() more efficient
|
2013-05-22 12:03:00 +01:00 |
|
Hieu Hoang
|
f4a75b30f7
|
Make lhsTarget a pointer
|
2013-05-22 11:22:17 +01:00 |
|
Hieu Hoang
|
53d625de5b
|
Get ready to make lhsTarget a pointer
|
2013-05-22 10:57:19 +01:00 |
|
Hieu Hoang
|
4fdda2e2d9
|
Get ready to make lhsTarget a pointer
|
2013-05-22 10:40:12 +01:00 |
|
Hieu Hoang
|
38c4b3695f
|
delete TargetPhrase::MutableTargetLHS(). Get ready to make lhsTarget a pointer
|
2013-05-22 10:26:06 +01:00 |
|
Hieu Hoang
|
2f38746f6a
|
delete references to translation feature weights. Everything is done automatically via Evaluate() for each feature function
|
2013-05-21 14:00:28 +01:00 |
|
Hieu Hoang
|
7dc177514d
|
delete references to WordPenaltyProducer
|
2013-05-21 13:50:18 +01:00 |
|
Hieu Hoang
|
81003b9464
|
delete references to WordPenaltyProducer
|
2013-05-21 13:44:19 +01:00 |
|
Hieu Hoang
|
195186b335
|
delete references to WordPenaltyProducer
|
2013-05-21 13:39:31 +01:00 |
|
Hieu Hoang
|
0e1c246010
|
delete references to WordPenaltyProducer
|
2013-05-21 13:22:04 +01:00 |
|
Hieu Hoang
|
fca7e0b530
|
delete references to MetaFeatureProducer
|
2013-05-21 13:12:29 +01:00 |
|
Hieu Hoang
|
f4cf5f152b
|
delete references to LMList
|
2013-05-21 13:00:26 +01:00 |
|
Hieu Hoang
|
42ddc084b4
|
delete references to LMList
|
2013-05-21 12:47:26 +01:00 |
|
Hieu Hoang
|
70873c3b8d
|
delete references to LMList
|
2013-05-21 12:33:51 +01:00 |
|
Hieu Hoang
|
ff880ec6f1
|
delete references to LMList
|
2013-05-21 12:27:13 +01:00 |
|
Hieu Hoang
|
031cbdf7cd
|
move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number
|
2013-05-20 19:57:46 +01:00 |
|
Hieu Hoang
|
3e7f412ae9
|
make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it
|
2013-05-20 17:01:19 +01:00 |
|
Hieu Hoang
|
a635518346
|
cannot negate size_t. Only a problem on 32-bit OSes
|
2013-05-20 13:02:16 +01:00 |
|
Hieu Hoang
|
aa938fd4ad
|
delete unused Evaluate() method in WordPnealtyFeature
|
2013-05-20 11:53:59 +01:00 |
|
Hieu Hoang
|
41da563645
|
port SRILM to new weights format
|
2013-05-19 12:44:45 +01:00 |
|
phikoehn
|
542cd72c63
|
moved config creation back into train-model.perl
|
2013-05-19 03:28:02 +01:00 |
|
Hieu Hoang
|
e800ee999b
|
put back #ifdef LM_IRST
|
2013-05-17 18:24:24 +01:00 |
|
Hieu Hoang
|
7b9141d70d
|
Merge branch 'master' of github.com:moses-smt/mosesdecoder
|
2013-05-16 22:51:08 +01:00 |
|
Hieu Hoang
|
03d5c670e7
|
don't load file if none is specified
|
2013-05-16 22:50:13 +01:00 |
|