Hieu Hoang
27152ccce4
add source labeller to EMS
2014-01-20 23:26:06 +00:00
phikoehn
4e75911331
changed biconcor location in EMS example config files
2014-01-16 13:58:45 +00:00
Hieu Hoang
ebc724b3de
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-01-12 13:51:04 +00:00
Hieu Hoang
a975e3d32d
Add Exception as a keyword for detecting error in EMS step
2014-01-12 13:50:01 +00:00
phikoehn
25553079d9
bug fix with sparse feature handling depending on word alignment in compact phrase table
2014-01-10 18:34:47 +00:00
phikoehn
9ea0f5dd0e
reporting on init (pretty slow for binary phrase table!) and bug fix in experiment.perl with setting filter settings
2014-01-05 22:39:47 +00:00
phikoehn
c8b5cc4f0e
avoid warning;
2013-12-31 19:21:28 +00:00
Nadir Durrani
7f75018349
Post-decoding Transliteration Script
2013-12-18 16:10:57 +00:00
Nadir Durrani
c291f859a0
Transliteration Mining
2013-12-16 18:19:44 +00:00
phikoehn
dab6a301fa
make reference-from-sgm.perl more robust
2013-11-30 02:00:04 +00:00
Hieu Hoang
f85d26ec60
delete reuse-weights.perl
2013-11-12 12:19:44 +00:00
Hieu Hoang
df3f3d130f
reuse-weights.perl --> substitute-weights.perl
2013-11-12 12:07:06 +00:00
JIDFmaster@JIDF.org
f68a92e9c1
correcting the reuse-weights.perl for a new format
2013-11-12 00:38:03 +01:00
Barry Haddow
97695164dd
Basic support for WADE analysis
...
Partial support for running WADE (http://www.umiacs.umd.edu/~hal/damt/ )
analysis from ems. You still need to create the input-reference alignments
somehow - for example by running training with the test set concatenated
to the training set.
To use WADE, (i) add 'wade = /path/to/wade.py' to the EVALUATION section and
(ii) add 'alignment = /path/to/alignments' to the approriate stanza
for each test set.
2013-11-01 16:56:55 +00:00
phikoehn
29d2c015a3
removed spurious $input-extension
2013-10-11 02:02:01 +01:00
Hieu Hoang
e8951c9243
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-10-10 21:30:17 +00:00
Hieu Hoang
9cbfa50102
add actual config file and run command used to train and decode this example
2013-10-10 21:30:07 +00:00
phikoehn
75e007d0f3
minor fixes
2013-10-10 10:12:56 +01:00
phikoehn
1e702c46b2
updated web interface for experiment.perl
2013-09-25 23:16:53 +01:00
Barry Haddow
ef43d6e038
Need phrase penalty weight
2013-09-11 10:59:48 +01:00
Barry Haddow
03997dfc3a
Change number of weights in example
2013-09-11 10:41:17 +01:00
phikoehn
9f40416ee4
changed default for hierarchical phrase table binarization
2013-09-08 18:30:48 +01:00
Barry Haddow
867c6efe6c
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-09-06 13:29:29 +01:00
Barry Haddow
7425036c3a
scoring correction
2013-09-06 13:29:20 +01:00
Nadir Durrani
4156c7acb6
Config files
2013-08-27 13:47:09 +01:00
Nadir Durrani
696c0eff61
Merge branch 'master' of https://github.com/moses-smt/mosesdecoder
2013-08-26 13:22:57 +01:00
nadir
fb35e1f3c9
Training Scripts for Factored OSM
2013-08-26 13:21:04 +01:00
phikoehn
79a2c98ff7
better ems support for different binarizers and reordering models
2013-08-25 20:30:37 +01:00
phikoehn
b368085609
xml constraint
2013-08-15 11:46:45 +01:00
Hieu Hoang
02c7af3fb8
Mira changes. Manually applied Eva's patch
2013-08-12 13:03:26 +01:00
Hieu Hoang
b05a443f36
correct arguments to substitute-filtered-tables-and-weights.perl
2013-07-30 11:14:17 +01:00
Barry Haddow
46ee1ca42d
More lattice fixes squashed by merge
2013-07-24 16:09:32 +01:00
Barry Haddow
d5e40a5b08
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2013-07-24 11:38:23 +01:00
Nadir Durrani
30544ae17e
Sample Config File
2013-07-23 12:29:23 +01:00
Nadir Durrani
61e56ecdcd
Sample Config File
2013-07-23 12:18:57 +01:00
Barry Haddow
ecc6c7177c
Reinstate lattice fixes squashed by merge
2013-07-22 17:25:01 +01:00
Nadir Durrani
deae3ac7b9
OSM entries in train-model.perl, experiment.*
2013-07-07 13:05:09 +01:00
Nadir Durrani
d2bc6a2584
In EMS
2013-07-04 19:58:19 +01:00
Nadir Durrani
fbdb07a94c
EMS
2013-07-03 10:54:38 +01:00
Wilker Aziz
2c19238c24
Patching up the suffix array wrappers
2013-06-24 15:38:10 +01:00
phikoehn
2e8fbe77a2
corrected example files
2013-06-08 14:45:55 +01:00
phikoehn
730da7edec
sparse feature specification bug fix
2013-06-08 13:39:15 +01:00
Graham Neubig
33d5aac6af
Fixed crash in interpolation for small lambdas
...
The EMS crashed when interpolating language models when the ideal lambdas included numbers so small that they required scientific notation (eg: 1.332e-07). This patch adds "e" and "-" to the acceptable numbers to fix this problem
2013-06-01 12:37:24 +09:00
phikoehn
68501f5a36
bug fix with weight substitution
2013-05-31 12:27:35 +01:00
phikoehn
8944ea541a
fast align parameter
2013-05-25 23:20:27 +01:00
phikoehn
542cd72c63
moved config creation back into train-model.perl
2013-05-19 03:28:02 +01:00
Hieu Hoang
0596ba4245
carry [weight-file] from tuned ini
2013-05-17 18:23:55 +01:00
Hieu Hoang
11632e298e
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 16:13:24 +01:00
Hieu Hoang
42c292765a
add substitute-filtered-tables-and-weights.perl for applying filter for evaluation step
2013-05-17 13:28:21 +01:00
phikoehn
4cdffc8a89
fixes for sparse feature handling
2013-05-17 08:37:29 +01:00