moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-30 15:34:01 +03:00
Code Issues Packages Projects Releases Wiki Activity
9,484 Commits 136 Branches 26 Tags 147 MiB
1ffae8010d
Commit Graph

71 Commits

Author SHA1 Message Date
Hieu Hoang
065597dc9f only include moses root when compiling 2012-11-14 14:18:53 +00:00
Eva Hasler
e7e4dbd405 merge remaining changes to mira, word pair features, phrase pair features 2012-10-03 18:53:55 +01:00
Eva Hasler
ebbf0d028c changes to mira, adding jackknife to experiment.perl 2012-10-01 20:36:52 +01:00
Eva Hasler
ea1bdd03f1 clean up mira 2012-07-04 11:40:12 +01:00
Eva Hasler
3c1728f30d clean up 2012-06-01 20:20:30 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Eva Hasler
9035a0ac85 fix margin normalisation 2012-05-02 17:57:24 +01:00
Eva Hasler
ef552fe91a remove caching of wp weight and translation weights, clean up mira code 2012-04-29 05:37:48 +01:00
Eva
4bc3982da7 add parameters --scale-margin-precision, --scale-update-precision 2012-03-18 16:38:13 +00:00
Eva Hasler
7ac84d5da9 add parameter --batch-equals-shard, --separate-updates 2012-03-11 16:18:42 +00:00
Eva Hasler
75e388ad1d add parameter --normalise-margin 2012-03-06 18:32:02 +00:00
Eva
ba7da1042d specify 5 different update schemes 2012-03-05 00:55:36 +00:00
Eva Hasler
19f591bb98 add modes 'rank-only' and 'hope-fear-rank' 2012-02-20 20:14:19 +00:00
Eva Hasler
f3daf4fac6 compute model score difference from model scores instead of from feature value difference 2012-02-20 17:27:35 +00:00
Eva Hasler
5e3331311e introduce boost parameter 2012-02-20 15:54:55 +00:00
Eva HASLER
b76eb947a0 remove correct-scaling vars 2012-02-03 20:49:43 +00:00
Eva Hasler
960c60c9c6 fix scaling correction.. (hopefully) 2012-01-31 18:14:28 +00:00
Eva Hasler
c06b5f4934 add parameter --correct-scaling 2012-01-23 15:15:27 +00:00
Eva Hasler
709484860e fix delayed updates, analytic update for 1 constraint 2012-01-23 12:22:12 +00:00
Eva Hasler
a050992abd add parameter --delay-updates 2012-01-14 15:56:16 +00:00
Eva Hasler
52f8dcb8fc add length-based example selection (--max-length-deviation) 2011-10-25 15:17:00 +01:00
ehasler
cd63771ca4 update parameters --scale-margin and --scale-update 
git-svn-id: http://svn.statmt.org/repository/mira@3923 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
ehasler
f658840f1a refactorings, remove burn-in code 
git-svn-id: http://svn.statmt.org/repository/mira@3922 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
ehasler
120be1df4f code clean-up, step 1 
git-svn-id: http://svn.statmt.org/repository/mira@3918 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
ehasler
42333388b4 change verbosity for cerr messages, remove some unwanted options, introduce --margin-slack, --margin-incr 
git-svn-id: http://svn.statmt.org/repository/mira@3913 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
14a0d2c8da enable target bigrams of POS tags 
git-svn-id: http://svn.statmt.org/repository/mira@3909 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
4e0f848d50 remove multiple oracles, remove accumulating constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3908 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
c0bb177791 enable margin scaling and update scaling with oracle bleu; remove fixed margin scaling 
git-svn-id: http://svn.statmt.org/repository/mira@3906 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
dedd322025 code cleanup 
git-svn-id: http://svn.statmt.org/repository/mira@3902 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
020c71216b For hope-fear option, add only constraints between hope and fear translations, not between hope translations. Make hope-fear sizes flexible with --hope-n and --fear-n 
git-svn-id: http://svn.statmt.org/repository/mira@3897 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
cda08ac2e3 fix problem with analytical update 
git-svn-id: http://svn.statmt.org/repository/mira@3895 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
a58dd23b03 remove stop-optimal parameter, default for precision is 1.0, fix flexible slack, inable analytical update 
git-svn-id: http://svn.statmt.org/repository/mira@3890 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
46cf77fa79 include precision option for constraint checking, fix some logs, ignore update when constraint change == 0 and error increases 
git-svn-id: http://svn.statmt.org/repository/mira@3888 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1964eaf98a refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight 
git-svn-id: http://svn.statmt.org/repository/mira@3882 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
10abc4fd62 update weighted loss, adapt accumulate-most-violated-constraints and --past-and-current-constraints to batching, accumulate 1 constraint per sentence in batch, additional option for accumulating only 1 constraint per batch --one-per-batch 
git-svn-id: http://svn.statmt.org/repository/mira@3878 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
bc7f8655d6 implement option --one-constraint that uses only the best model translation and the oracle and computes the update analytically 
git-svn-id: http://svn.statmt.org/repository/mira@3877 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
f29d58e3f3 bleu before and after opt. for batch, print error of constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3871 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
16edd0b9bc track the number of violated constraints and constraint changes 
git-svn-id: http://svn.statmt.org/repository/mira@3869 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
0cbc5b06f4 forgot to check in .h file 
git-svn-id: http://svn.statmt.org/repository/mira@3863 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
269f1018c3 introduce option to use average weights for pruning 
git-svn-id: http://svn.statmt.org/repository/mira@3852 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
d04066ee0e introduce parameter --update-after-epoch 
git-svn-id: http://svn.statmt.org/repository/mira@3845 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
41d2d28408 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update, new 
git-svn-id: http://svn.statmt.org/repository/mira@3844 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
f95a9d5d26 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update 
git-svn-id: http://svn.statmt.org/repository/mira@3843 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
8d95753d0c back to dumping cumulative weights, fix learning rate and max-sentence-update 
git-svn-id: http://svn.statmt.org/repository/mira@3831 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
75565119d2 introduce parameters --max-sentence-update, --check-updates, --decr-learning-rate, change some default values, code cleanup 
git-svn-id: http://svn.statmt.org/repository/mira@3819 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
5312e8fc22 compute bleu on oracles translations of dev set, introduce params --min-weight-change, --msf-step, --msf-min, --slack-step, --slack-max, --decoder-settings 
git-svn-id: http://svn.statmt.org/repository/mira@3804 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
evahasler
2f1b959302 change bleu smoothing, change handling of multiple oracles, parameter for increasing BP 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3770 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-10 16:34:43 +00:00
evahasler
cd62ffc021 mpi abort, compute error over fixed set of ex., add params --suppress-convergence and --past-and-current-constraints 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3766 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-09 18:55:52 +00:00
evahasler
7c238b6b44 add parameters --accumulate-oracles and --accumulate-most-violated-constraints 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3765 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-09 11:49:52 +00:00