phikoehn
ce372477c9
conversion script from Moses V1.0 moses.ini files to current format - may need some further tweaking
2013-06-09 14:28:56 +01:00
phikoehn
2e8fbe77a2
corrected example files
2013-06-08 14:45:55 +01:00
phikoehn
730da7edec
sparse feature specification bug fix
2013-06-08 13:39:15 +01:00
Hieu Hoang
a974bbafac
Merge pull request #37 from neubig/ems-interpolate-scientific
...
Fixed crash in interpolation for small lambdas
2013-06-07 16:24:32 -07:00
Rico Sennrich
8581fb9518
fix (minor) unicode warning, and update permissions
2013-06-03 13:48:31 +02:00
Graham Neubig
33d5aac6af
Fixed crash in interpolation for small lambdas
...
The EMS crashed when interpolating language models when the ideal lambdas included numbers so small that they required scientific notation (eg: 1.332e-07). This patch adds "e" and "-" to the acceptable numbers to fix this problem
2013-06-01 12:37:24 +09:00
phikoehn
68501f5a36
bug fix with weight substitution
2013-05-31 12:27:35 +01:00
Hieu Hoang
f83622b0b7
figure out which feature function to apply at which decode step. Book-keeping
2013-05-30 17:16:10 +01:00
Hieu Hoang
8f7c12ef40
beautify
2013-05-29 18:19:06 +01:00
Hieu Hoang
6249432407
beautify
2013-05-29 18:16:15 +01:00
Hieu Hoang
beaf295741
beautify
2013-05-27 17:47:54 +01:00
Hieu Hoang
6996973a56
beautify
2013-05-27 17:42:27 +01:00
phikoehn
8944ea541a
fast align parameter
2013-05-25 23:20:27 +01:00
phikoehn
542cd72c63
moved config creation back into train-model.perl
2013-05-19 03:28:02 +01:00
Hieu Hoang
0596ba4245
carry [weight-file] from tuned ini
2013-05-17 18:23:55 +01:00
Hieu Hoang
11632e298e
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 16:13:24 +01:00
Hieu Hoang
42c292765a
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 13:28:21 +01:00
phikoehn
4cdffc8a89
fixes for sparse feature handling
2013-05-17 08:37:29 +01:00
phikoehn
13991fc88f
added specification to example config files for fast align
2013-05-17 06:42:54 +01:00
Hieu Hoang
35d37a91a1
Don't print 'sparse' for sparse feature functions. All features functions can contains dense and sparse
2013-05-16 23:36:59 +01:00
Barry Haddow
585786d26b
can specify location of create-ini
2013-05-16 19:34:56 +01:00
Hieu Hoang
f96a82d26c
add normalize-punctuation.perl, from WMT
2013-05-16 17:03:37 +01:00
Hieu Hoang
8dd84d7a40
change integration of sparse features with EMS to account for new weights format
2013-05-16 15:38:05 +01:00
Hieu Hoang
7522f3963c
change PhraseDictionaryTreeAdaptor --> PhraseDictionaryBinary
2013-05-15 09:35:28 +01:00
Barry Haddow
a4ce50f2fb
Fix for cygwin
2013-05-14 08:54:29 +01:00
phikoehn
41da5b2760
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-05-12 08:16:22 +01:00
Hieu Hoang
40bc98df56
filter Memory --> OnDisk and Binary
2013-05-11 21:57:03 +01:00
Hieu Hoang
51fc6fdcb6
filter Memory --> OnDisk and Binary
2013-05-11 21:46:45 +01:00
Hieu Hoang
a8f4e2c8fe
changes for cruise control
2013-05-10 15:43:49 +01:00
Hieu Hoang
e2f2aff94a
merged. Mostly by discarding new changes
2013-05-03 14:36:39 +01:00
Barry Haddow
8a965cd62e
Fixes to binarize-all
2013-05-03 10:15:37 +01:00
Barry Haddow
8993339df4
Make sure tuning uses filtered config when available.
2013-05-02 18:50:21 +01:00
Barry Haddow
cf47ad132c
Ability to specify number of conf net weights
2013-05-02 18:50:03 +01:00
Hieu Hoang
929b153216
merge
2013-05-02 17:59:36 +01:00
Barry Haddow
48fe0610ef
Merge branch 'master' of github.com:moses-smt/mosesdecoder
...
Conflicts:
scripts/training/filter-model-given-input.pl
2013-05-02 17:02:51 +01:00
Barry Haddow
5eebb9538e
Enable skipping of filtering in EMS
...
Use 'binarize-all = path-to-binarize-model.perl
2013-05-02 15:15:52 +01:00
Barry Haddow
72cbadaed5
Back to type 99
2013-05-02 15:11:17 +01:00
Ondrej Bojar
0450fd6776
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2013-05-02 00:33:52 +02:00
Ondrej Bojar
b57f5a530e
allow disabling distortion model binarization
2013-05-02 00:33:09 +02:00
phikoehn
d19a28ae21
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-05-01 19:22:00 +01:00
phikoehn
cd8915647b
support for Chris Dyer's fast-align; bug fix with sparse word translations feature; threshold pruning in filter
2013-05-01 19:20:05 +01:00
Hieu Hoang
3ed17bbedd
merge
2013-05-01 11:50:29 +01:00
Barry Haddow
5638aa6a32
don't rebuild tables when a TRAINING:config is specified
2013-05-01 11:25:32 +01:00
Ondrej Bojar
3e2b83444d
gzip ttable when binarizing, use --tempdir, fixed a flushing bug
2013-05-01 11:49:58 +02:00
Barry Haddow
b38c318e84
Update to use multi model
2013-04-30 14:04:39 +01:00
Hieu Hoang
ce95c117f6
merge
2013-04-29 18:46:48 +01:00
Rico Sennrich
908c006e32
online combination of multiple phrase tables
...
- creates a virtual phrase table at decoding time based on a vector of component models and a combination algorithm
- linear interpolation or instance weighting
- two possible component model types supported so far: 0 (in-memory) or 12 (compact)
- weights can be set in config, and overriden on a sentence-level through mosesserver API
- online optimization (perplexity minimization) using dlib and xmlrpc-c call
2013-04-22 13:21:59 +02:00
Hieu Hoang
b1da4dbe0e
merged
2013-04-19 15:03:34 +01:00
Barry Haddow
9d42c7f6f7
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-04-12 16:07:26 +01:00
Hieu Hoang
44a0e52e30
fixed ShowWeights() for confusion networks. This is a reason why we should get rid of ShortNames and move to refactored moses pdq
2013-04-09 14:44:32 +01:00
