Hieu Hoang
031cbdf7cd
move parsing of input-factor and output-factor into class DecodeFeature. Fixed bug in parsing this in class GenerationDictionary, which only picked up the 1st number
2013-05-20 19:57:46 +01:00
Hieu Hoang
3e7f412ae9
make InitDictionary() an abstract method, at Uli's suggestion. Make sure people implements it
2013-05-20 17:01:19 +01:00
Hieu Hoang
a635518346
cannot negate size_t. Only a problem on 32-bit OSes
2013-05-20 13:02:16 +01:00
Hieu Hoang
aa938fd4ad
delete unused Evaluate() method in WordPnealtyFeature
2013-05-20 11:53:59 +01:00
Hieu Hoang
e13884dbc4
rollback change 'cos Ken is hassling me
2013-05-19 21:13:00 +01:00
Hieu Hoang
33588b702c
compile error on mac osx. Just #ifdef for now, but should use Boost or something to make it cross-platform. It keeps happening
2013-05-19 19:16:52 +01:00
Kenneth Heafield
1c81c5582f
Make a slow code path for std::set FindStringPiece. I had fixed sparse features to use hash tables. But Hieu reverted this and kludged
...
FindStringPiece to be slow. This change returns my code to being fast and leaves the performance problem to Hieu/Eva.
2013-05-19 10:22:50 -04:00
Kenneth Heafield
50652382e9
KenLM 10ddf7d923355b35a7de9a5219673eca9e18be98 except Hieu's slow string_piece_hash
2013-05-19 10:12:06 -04:00
Hieu Hoang
41da563645
port SRILM to new weights format
2013-05-19 12:44:45 +01:00
phikoehn
542cd72c63
moved config creation back into train-model.perl
2013-05-19 03:28:02 +01:00
Hieu Hoang
668bda8623
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-17 18:24:38 +01:00
Hieu Hoang
e800ee999b
put back #ifdef LM_IRST
2013-05-17 18:24:24 +01:00
Hieu Hoang
0596ba4245
carry [weight-file] from tuned ini
2013-05-17 18:23:55 +01:00
Hieu Hoang
11632e298e
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 16:13:24 +01:00
Hieu Hoang
42c292765a
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 13:28:21 +01:00
phikoehn
4cdffc8a89
fixes for sparse feature handling
2013-05-17 08:37:29 +01:00
phikoehn
13991fc88f
added specification to example config files for fast align
2013-05-17 06:42:54 +01:00
Kenneth Heafield
ce516b770c
Merge pull request #35 from lixiangnlp/patch-1
...
Update search_trie.hh
2013-05-16 16:21:55 -07:00
Hieu Hoang
35d37a91a1
Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 23:36:59 +01:00
Hieu Hoang
7b9141d70d
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-16 22:51:08 +01:00
Hieu Hoang
03d5c670e7
don't load file if none is specified
2013-05-16 22:50:13 +01:00
Hieu Hoang
64b4a8805a
remove all mention of MetaFeature
2013-05-16 19:41:35 +01:00
Barry Haddow
585786d26b
can specify location of create-ini
2013-05-16 19:34:56 +01:00
Hieu Hoang
ab51ccff6d
assert error when outputting pure sparse feature by ShowWeights()
2013-05-16 19:12:54 +01:00
Hieu Hoang
f04ec4c56d
1. remove all code for MetaFeature from mira.
...
2. in ShowWeights(), all print out dense feature weights. Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 19:05:08 +01:00
Hieu Hoang
b322e78a38
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-16 18:06:15 +01:00
Hieu Hoang
71a52d5f3c
tidy up
2013-05-16 18:05:39 +01:00
Hieu Hoang
f96a82d26c
add normalize-punctuation.perl, from WMT
2013-05-16 17:03:37 +01:00
Hieu Hoang
97d6cb1caa
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-16 15:38:26 +01:00
Hieu Hoang
8dd84d7a40
change integration of sparse features with EMS to account for new weights format
2013-05-16 15:38:05 +01:00
Rico Sennrich
5fa1752018
multimodel(counts): allow different features to have separate interpolation weights.
2013-05-16 14:11:03 +02:00
Rico Sennrich
876de13eba
restore support for multimodel(counts) in moses server:
...
set sentence-level weights and optimize weights
2013-05-16 13:40:17 +02:00
Xiang Li
1b63277e66
Update search_trie.hh
...
There is no array compression header for order 2 models
2013-05-16 10:27:46 +08:00
Hieu Hoang
3876c47d1d
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-15 15:52:08 +01:00
Hieu Hoang
b2488f83c3
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-15 14:34:31 +01:00
Hieu Hoang
02099a9d73
add test for sparse feature PhraseLengthFeature
2013-05-15 12:20:44 +01:00
Hieu Hoang
0f75865faa
1. Get rid of GetSparseFeatureReporting(). Always report detailed sparse features, if they exist.
...
2. Name sparse features properly in class WordTranslationFeature
2013-05-15 11:37:21 +01:00
Hieu Hoang
08cf480516
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-15 09:35:45 +01:00
Hieu Hoang
7522f3963c
change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary
2013-05-15 09:35:28 +01:00
Hieu Hoang
81ffe84dbc
port PhraseDictionaryMultiModelCounts to new format. Runs but doesn't pass regression test
2013-05-14 17:35:22 +01:00
Hieu Hoang
66ad7c3c18
port PhraseDictionaryMultiModelCounts to new format
2013-05-14 15:16:09 +01:00
Hieu Hoang
0c3fa9942b
port PhraseDictionaryMultiModelCounts to new format
2013-05-14 13:11:55 +01:00
Hieu Hoang
44da13082f
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-05-14 12:29:35 +01:00
Hieu Hoang
686f545d78
unabbreviate some sparse feature names
2013-05-14 12:24:51 +01:00
Hieu Hoang
34df0011a9
change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary
2013-05-14 12:19:55 +01:00
Barry Haddow
a4ce50f2fb
Fix for cygwin
2013-05-14 08:54:29 +01:00
phikoehn
8dea116064
Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder
2013-05-14 07:19:45 +01:00
Hieu Hoang
5f6f27dea5
compile error. Delete reference to TranslationSystem
2013-05-13 20:48:05 +01:00
Hieu Hoang
d5ebe61791
port PhraseDictionaryMultiModelCount to new format
2013-05-13 18:40:12 +01:00
Hieu Hoang
b8efef6667
port PhraseDictionaryMultiModelCount to new format
2013-05-13 18:39:06 +01:00
