phikoehn
68501f5a36
bug fix with weight substitution
2013-05-31 12:27:35 +01:00
Hieu Hoang
f83622b0b7
figure out which feature function to apply at which decode step. Book-keeping
2013-05-30 17:16:10 +01:00
Hieu Hoang
8f7c12ef40
beautify
2013-05-29 18:19:06 +01:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
beaf295741
beautify
2013-05-27 17:47:54 +01:00
Hieu Hoang
6996973a56
beautify
2013-05-27 17:42:27 +01:00
phikoehn
8944ea541a
fast align parameter
2013-05-25 23:20:27 +01:00
phikoehn
542cd72c63
moved config creation back into train-model.perl
2013-05-19 03:28:02 +01:00
Hieu Hoang
0596ba4245
carry [weight-file] from tuned ini
2013-05-17 18:23:55 +01:00
Hieu Hoang
11632e298e
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 16:13:24 +01:00
Hieu Hoang
42c292765a
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 13:28:21 +01:00
phikoehn
4cdffc8a89
fixes for sparse feature handling
2013-05-17 08:37:29 +01:00
phikoehn
13991fc88f
added specification to example config files for fast align
2013-05-17 06:42:54 +01:00
Hieu Hoang
35d37a91a1
Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 23:36:59 +01:00
Barry Haddow
585786d26b
can specify location of create-ini
2013-05-16 19:34:56 +01:00
Hieu Hoang
f96a82d26c
add normalize-punctuation.perl, from WMT
2013-05-16 17:03:37 +01:00
Hieu Hoang
8dd84d7a40
change integration of sparse features with EMS to account for new weights format
2013-05-16 15:38:05 +01:00
Hieu Hoang
7522f3963c
change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary
2013-05-15 09:35:28 +01:00
Barry Haddow
a4ce50f2fb
Fix for cygwin
2013-05-14 08:54:29 +01:00
phikoehn
41da5b2760
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-05-12 08:16:22 +01:00
Hieu Hoang
40bc98df56
filter Memory --> OnDisk and Binary
2013-05-11 21:57:03 +01:00
Hieu Hoang
51fc6fdcb6
filter Memory --> OnDisk and Binary
2013-05-11 21:46:45 +01:00
Hieu Hoang
a8f4e2c8fe
changes for cruise control
2013-05-10 15:43:49 +01:00
Hieu Hoang
e2f2aff94a
merged. Mostly by discarding new changes
2013-05-03 14:36:39 +01:00
Barry Haddow
8a965cd62e
Fixes to binarize-all
2013-05-03 10:15:37 +01:00
Barry Haddow
8993339df4
Make sure tuning uses filtered config when available.
2013-05-02 18:50:21 +01:00
Barry Haddow
cf47ad132c
Ability to specify number of conf net weights
2013-05-02 18:50:03 +01:00
Hieu Hoang
929b153216
merge
2013-05-02 17:59:36 +01:00
Barry Haddow
48fe0610ef
Merge branch 'master' of github.com:moses-smt/mosesdecoder
...
Conflicts:
scripts/training/filter-model-given-input.pl
2013-05-02 17:02:51 +01:00
Barry Haddow
5eebb9538e
Enable skipping of filtering in EMS
...
Use 'binarize-all = path-to-binarize-model.perl
2013-05-02 15:15:52 +01:00
Barry Haddow
72cbadaed5
Back to type 99
2013-05-02 15:11:17 +01:00
Ondrej Bojar
0450fd6776
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2013-05-02 00:33:52 +02:00
Ondrej Bojar
b57f5a530e
allow disabling distortion model binarization
2013-05-02 00:33:09 +02:00
phikoehn
d19a28ae21
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-05-01 19:22:00 +01:00
phikoehn
cd8915647b
support for Chris Dyer's fast-align; bug fix with sparse word translations feature; threshold pruning in filter
2013-05-01 19:20:05 +01:00
Hieu Hoang
3ed17bbedd
merge
2013-05-01 11:50:29 +01:00
Barry Haddow
5638aa6a32
don't rebuild tables when a TRAINING:config is specified
2013-05-01 11:25:32 +01:00
Ondrej Bojar
3e2b83444d
gzip ttable when binarizing, use --tempdir, fixed a flushing bug
2013-05-01 11:49:58 +02:00
Barry Haddow
b38c318e84
Update to use multi model
2013-04-30 14:04:39 +01:00
Hieu Hoang
ce95c117f6
merge
2013-04-29 18:46:48 +01:00
Rico Sennrich
908c006e32
online combination of multiple phrase tables
...
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
- linear interpolation or instance weighting
- two possible component model types supported so far: 0 (in-memory) or 12 (compact)
- weights can be set in config, and overriden on a sentence-level through mosesserver API
- online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Hieu Hoang
b1da4dbe0e
merged
2013-04-19 15:03:34 +01:00
Barry Haddow
9d42c7f6f7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-12 16:07:26 +01:00
Hieu Hoang
44a0e52e30
fixed ShowWeights() for confusion networks. This is a reason why we should get rid of ShortNames and move to refactored moses pdq
2013-04-09 14:44:32 +01:00
Hieu Hoang
e603e965a5
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-04-08 17:52:27 +01:00
phikoehn
ac82be3120
Hal moved. We follow.
2013-04-03 21:59:03 +01:00
Hieu Hoang
2655300c83
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-04-03 19:26:49 +01:00
Ondrej Bojar
93433cf015
support --translation-details OUTFILE in moses-parallel
2013-04-03 18:10:44 +02:00
Hieu Hoang
71a2b49a47
Merge github.com:moses-smt/mosesdecoder into weight-new
2013-04-01 16:43:32 +01:00
phikoehn
0a978e9f01
bug fixes
2013-04-01 14:31:32 +01:00