phikoehn
d6b62db5b1
fix bug if interpolated lm on different factors
2014-02-12 21:00:55 +00:00
Hieu Hoang
ebc724b3de
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2014-01-12 13:51:04 +00:00
Hieu Hoang
a975e3d32d
Add Exception as a keyword for detecting error in EMS step
2014-01-12 13:50:01 +00:00
phikoehn
25553079d9
bug fix with sparse feature handling depending on word alignment in compact phrase table
2014-01-10 18:34:47 +00:00
phikoehn
9ea0f5dd0e
reporting on init (pretty slow for binary phrase table!) and bug fix in experiment.perl with setting filter settings
2014-01-05 22:39:47 +00:00
phikoehn
c8b5cc4f0e
avoid warning;
2013-12-31 19:21:28 +00:00
Nadir Durrani
7f75018349
Post-decoding Transliteration Script
2013-12-18 16:10:57 +00:00
Nadir Durrani
c291f859a0
Transliteration Mining
2013-12-16 18:19:44 +00:00
Hieu Hoang
df3f3d130f
reuse-weights.perl --> substitute-weights.perl
2013-11-12 12:07:06 +00:00
Barry Haddow
97695164dd
Basic support for WADE analysis
...
Partial support for running WADE (http://www.umiacs.umd.edu/~hal/damt/ )
analysis from ems. You still need to create the input-reference alignments
somehow - for example by running training with the test set concatenated
to the training set.
To use WADE, (i) add 'wade = /path/to/wade.py' to the EVALUATION section and
(ii) add 'alignment = /path/to/alignments' to the approriate stanza
for each test set.
2013-11-01 16:56:55 +00:00
nadir
fb35e1f3c9
Training Scripts for Factored OSM
2013-08-26 13:21:04 +01:00
Hieu Hoang
02c7af3fb8
Mira changes. Manually applied Eva's patch
2013-08-12 13:03:26 +01:00
Nadir Durrani
d2bc6a2584
In EMS
2013-07-04 19:58:19 +01:00
Wilker Aziz
2c19238c24
Patching up the suffix array wrappers
2013-06-24 15:38:10 +01:00
phikoehn
542cd72c63
moved config creation back into train-model.perl
2013-05-19 03:28:02 +01:00
phikoehn
4cdffc8a89
fixes for sparse feature handling
2013-05-17 08:37:29 +01:00
Barry Haddow
585786d26b
can specify location of create-ini
2013-05-16 19:34:56 +01:00
phikoehn
41da5b2760
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2013-05-12 08:16:22 +01:00
Hieu Hoang
e2f2aff94a
merged. Mostly by discarding new changes
2013-05-03 14:36:39 +01:00
Barry Haddow
8993339df4
Make sure tuning uses filtered config when available.
2013-05-02 18:50:21 +01:00
Barry Haddow
5eebb9538e
Enable skipping of filtering in EMS
...
Use 'binarize-all = path-to-binarize-model.perl
2013-05-02 15:15:52 +01:00
phikoehn
cd8915647b
support for Chris Dyer's fast-align; bug fix with sparse word translations feature; threshold pruning in filter
2013-05-01 19:20:05 +01:00
Hieu Hoang
1f1a0297db
runtime error in creating ini file
2013-03-16 15:05:14 +00:00
Hieu Hoang
3271710dd5
tell create-ini about input factors
2013-03-11 19:31:53 +00:00
Hieu Hoang
7fb363d922
tell create-ini what factors are being used
2013-03-11 13:42:26 +00:00
Hieu Hoang
3e60705ec2
change format of pt. Allow overriding of feature name
2013-03-06 12:39:41 +00:00
Hieu Hoang
b9b74c53ae
new ini file with hiero models
2013-02-18 16:51:44 +00:00
Hieu Hoang
9fe9b0008b
new ini file with hiero models
2013-02-18 12:05:10 +00:00
Hieu Hoang
ae52a15c4d
use new create-ini program to create ini file, rather than step 9 of train-model.perl
2013-02-14 12:07:48 +00:00
Hieu Hoang
825edd282b
use new create-ini program to create ini file, rather than step 9 of train-model.perl
2013-02-14 11:19:40 +00:00
phikoehn
344b150372
bug fixes with escaping / truecasing interactions
2013-01-14 19:22:29 +00:00
phikoehn
b275c94dbf
allow for inclusion of extract from previous run
2012-12-12 07:02:59 +00:00
phikoehn
24e1df7520
support for use of baseline alignment model
2012-12-12 03:59:14 +00:00
phikoehn
438dcb1a34
bug fix in experiment.perl wrt. get-corpus-script
2012-12-10 23:50:14 +00:00
phikoehn
ed2d191821
allow specification of end point for experiment.perl
2012-12-10 05:56:51 +00:00
phikoehn
ccf9e13d8e
bug fix with multicore parallelizer
2012-12-09 22:27:02 +00:00
phikoehn
338b7656a6
ooops
2012-11-30 07:36:59 +00:00
phikoehn
ea610a0558
added modified-moore-lewis from Barry Haddow into EMS
2012-11-24 12:43:13 +00:00
phikoehn
d4cebb008a
added ems support for sigtest-filter
2012-11-23 17:35:13 +00:00
Barry Haddow
a90e1861c0
Alignments on by default for phrase-based
2012-11-15 12:35:43 +00:00
Barry Haddow
5e3726eb90
Remove -use-alignment-info
2012-11-15 09:42:58 +00:00
Barry Haddow
095b307cfc
Make sure alignment info is not on for hiero
2012-11-08 18:16:53 +00:00
Barry Haddow
12786dd58f
Alignments on by default.
...
Use TRAINING:include-word-alignment-in-rules = no
to turn them off.
2012-11-08 17:52:10 +00:00
Barry Haddow
01c4de24b7
don't delete moses ini specified in config
2012-11-06 10:59:15 +00:00
phikoehn
0dda804c46
sparse feature fixes
2012-10-18 03:09:49 +01:00
phikoehn
98dafc0301
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2012-10-18 02:20:45 +01:00
phikoehn
f19d53dac9
minor fixes
2012-10-18 02:20:38 +01:00
Barry Haddow
61ae24aa5d
Merge remote-tracking branch 'origin/master' into miramerge
...
Conflicts:
moses/src/PhraseDictionary.cpp
moses/src/TargetPhrase.cpp
moses/src/TargetPhrase.h
2012-10-14 14:18:03 +01:00
Lane Schwartz
11679849db
In verbose mode, experiment.perl should print the full qsub command
...
prior to actually running it.
2012-10-10 13:25:58 -04:00
Lane Schwartz
0904531749
Make experiment.perl use qsub-settings from GENERAL section
...
if no qsub-settings are defined for the specific section being run.
2012-10-10 13:25:09 -04:00