Commit Graph

75 Commits

Author SHA1 Message Date
Eva Hasler
90fe3514bc remove unused code 2013-10-05 14:34:05 +01:00
Hieu Hoang
8419a3af35 beautify 2013-08-14 12:37:22 +01:00
Hieu Hoang
02c7af3fb8 Mira changes. Manually applied Eva's patch 2013-08-12 13:03:26 +01:00
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
065597dc9f only include moses root when compiling 2012-11-14 14:18:53 +00:00
Eva Hasler
e7e4dbd405 merge remaining changes to mira, word pair features, phrase pair features 2012-10-03 18:53:55 +01:00
Eva Hasler
ebbf0d028c changes to mira, adding jackknife to experiment.perl 2012-10-01 20:36:52 +01:00
Eva Hasler
ea1bdd03f1 clean up mira 2012-07-04 11:40:12 +01:00
Eva Hasler
3c1728f30d clean up 2012-06-01 20:20:30 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Eva Hasler
9035a0ac85 fix margin normalisation 2012-05-02 17:57:24 +01:00
Eva Hasler
ef552fe91a remove caching of wp weight and translation weights, clean up mira code 2012-04-29 05:37:48 +01:00
Eva
4bc3982da7 add parameters --scale-margin-precision, --scale-update-precision 2012-03-18 16:38:13 +00:00
Eva Hasler
7ac84d5da9 add parameter --batch-equals-shard, --separate-updates 2012-03-11 16:18:42 +00:00
Eva Hasler
75e388ad1d add parameter --normalise-margin 2012-03-06 18:32:02 +00:00
Eva
ba7da1042d specify 5 different update schemes 2012-03-05 00:55:36 +00:00
Eva Hasler
19f591bb98 add modes 'rank-only' and 'hope-fear-rank' 2012-02-20 20:14:19 +00:00
Eva Hasler
f3daf4fac6 compute model score difference from model scores instead of from feature value difference 2012-02-20 17:27:35 +00:00
Eva Hasler
5e3331311e introduce boost parameter 2012-02-20 15:54:55 +00:00
Eva HASLER
b76eb947a0 remove correct-scaling vars 2012-02-03 20:49:43 +00:00
Eva Hasler
960c60c9c6 fix scaling correction.. (hopefully) 2012-01-31 18:14:28 +00:00
Eva Hasler
c06b5f4934 add parameter --correct-scaling 2012-01-23 15:15:27 +00:00
Eva Hasler
709484860e fix delayed updates, analytic update for 1 constraint 2012-01-23 12:22:12 +00:00
Eva Hasler
a050992abd add parameter --delay-updates 2012-01-14 15:56:16 +00:00
Eva Hasler
52f8dcb8fc add length-based example selection (--max-length-deviation) 2011-10-25 15:17:00 +01:00
ehasler
cd63771ca4 update parameters --scale-margin and --scale-update
git-svn-id: http://svn.statmt.org/repository/mira@3923 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
f658840f1a refactorings, remove burn-in code
git-svn-id: http://svn.statmt.org/repository/mira@3922 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
120be1df4f code clean-up, step 1
git-svn-id: http://svn.statmt.org/repository/mira@3918 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
42333388b4 change verbosity for cerr messages, remove some unwanted options, introduce --margin-slack, --margin-incr
git-svn-id: http://svn.statmt.org/repository/mira@3913 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
14a0d2c8da enable target bigrams of POS tags
git-svn-id: http://svn.statmt.org/repository/mira@3909 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
4e0f848d50 remove multiple oracles, remove accumulating constraints
git-svn-id: http://svn.statmt.org/repository/mira@3908 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
c0bb177791 enable margin scaling and update scaling with oracle bleu; remove fixed margin scaling
git-svn-id: http://svn.statmt.org/repository/mira@3906 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
dedd322025 code cleanup
git-svn-id: http://svn.statmt.org/repository/mira@3902 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
020c71216b For hope-fear option, add only constraints between hope and fear translations, not between hope translations. Make hope-fear sizes flexible with --hope-n and --fear-n
git-svn-id: http://svn.statmt.org/repository/mira@3897 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
cda08ac2e3 fix problem with analytical update
git-svn-id: http://svn.statmt.org/repository/mira@3895 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
a58dd23b03 remove stop-optimal parameter, default for precision is 1.0, fix flexible slack, inable analytical update
git-svn-id: http://svn.statmt.org/repository/mira@3890 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
46cf77fa79 include precision option for constraint checking, fix some logs, ignore update when constraint change == 0 and error increases
git-svn-id: http://svn.statmt.org/repository/mira@3888 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
1964eaf98a refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight
git-svn-id: http://svn.statmt.org/repository/mira@3882 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
10abc4fd62 update weighted loss, adapt accumulate-most-violated-constraints and --past-and-current-constraints to batching, accumulate 1 constraint per sentence in batch, additional option for accumulating only 1 constraint per batch --one-per-batch
git-svn-id: http://svn.statmt.org/repository/mira@3878 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
bc7f8655d6 implement option --one-constraint that uses only the best model translation and the oracle and computes the update analytically
git-svn-id: http://svn.statmt.org/repository/mira@3877 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
f29d58e3f3 bleu before and after opt. for batch, print error of constraints
git-svn-id: http://svn.statmt.org/repository/mira@3871 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
16edd0b9bc track the number of violated constraints and constraint changes
git-svn-id: http://svn.statmt.org/repository/mira@3869 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
0cbc5b06f4 forgot to check in .h file
git-svn-id: http://svn.statmt.org/repository/mira@3863 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
269f1018c3 introduce option to use average weights for pruning
git-svn-id: http://svn.statmt.org/repository/mira@3852 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
d04066ee0e introduce parameter --update-after-epoch
git-svn-id: http://svn.statmt.org/repository/mira@3845 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
41d2d28408 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update, new
git-svn-id: http://svn.statmt.org/repository/mira@3844 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
f95a9d5d26 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update
git-svn-id: http://svn.statmt.org/repository/mira@3843 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
8d95753d0c back to dumping cumulative weights, fix learning rate and max-sentence-update
git-svn-id: http://svn.statmt.org/repository/mira@3831 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
75565119d2 introduce parameters --max-sentence-update, --check-updates, --decr-learning-rate, change some default values, code cleanup
git-svn-id: http://svn.statmt.org/repository/mira@3819 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00