moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2025-01-03 17:33:52 +03:00
Code Issues Packages Projects Releases Wiki Activity
6,159 Commits 136 Branches 26 Tags 147 MiB
a4cc2efbe5
Commit Graph

192 Commits

Author SHA1 Message Date
ehasler
a4cc2efbe5 do not skip_submit by default 
git-svn-id: http://svn.statmt.org/repository/mira@3911 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
29cb9271e6 enable only creating but not submitting test jobs 
git-svn-id: http://svn.statmt.org/repository/mira@3910 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
14a0d2c8da enable target bigrams of POS tags 
git-svn-id: http://svn.statmt.org/repository/mira@3909 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
4e0f848d50 remove multiple oracles, remove accumulating constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3908 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
72da32f0cb update training script 
git-svn-id: http://svn.statmt.org/repository/mira@3907 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
c0bb177791 enable margin scaling and update scaling with oracle bleu; remove fixed margin scaling 
git-svn-id: http://svn.statmt.org/repository/mira@3906 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
c8c3f763ec fix setting core features for multi-score features 
git-svn-id: http://svn.statmt.org/repository/mira@3905 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
5c4be22240 remove bug in updateWeightsHopeFear() 
git-svn-id: http://svn.statmt.org/repository/mira@3904 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
09def6be90 change param dependencies 
git-svn-id: http://svn.statmt.org/repository/mira@3903 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
dedd322025 code cleanup 
git-svn-id: http://svn.statmt.org/repository/mira@3902 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
d598fc4c85 print oracle/reference length, implement --core-weights 
git-svn-id: http://svn.statmt.org/repository/mira@3901 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
ccb4cf0fb2 add m_precision to modelScoreDiff 
git-svn-id: http://svn.statmt.org/repository/mira@3900 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
0280af11dd Fix vector initialisation, comments 
git-svn-id: http://svn.statmt.org/repository/mira@3899 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
f431ea0557 Fix vector initialisation 
git-svn-id: http://svn.statmt.org/repository/mira@3898 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
020c71216b For hope-fear option, add only constraints between hope and fear translations, not between hope translations. Make hope-fear sizes flexible with --hope-n and --fear-n 
git-svn-id: http://svn.statmt.org/repository/mira@3897 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
a177b58d18 set precision to 0, set hope-fear to 1, dont add constraints for equal translations 
git-svn-id: http://svn.statmt.org/repository/mira@3896 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
cda08ac2e3 fix problem with analytical update 
git-svn-id: http://svn.statmt.org/repository/mira@3895 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
1da0544d77 enable 1best history for perceptron/analytical update 
git-svn-id: http://svn.statmt.org/repository/mira@3894 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
86dba9f743 default: stop when weights converge 
git-svn-id: http://svn.statmt.org/repository/mira@3892 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
a1d2252529 enable perceptron update with only 1 hope and fear translation each 
git-svn-id: http://svn.statmt.org/repository/mira@3891 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
a58dd23b03 remove stop-optimal parameter, default for precision is 1.0, fix flexible slack, inable analytical update 
git-svn-id: http://svn.statmt.org/repository/mira@3890 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
bc2a2078ea add 1best decoding after optimization for --updates-per-epoch option 
git-svn-id: http://svn.statmt.org/repository/mira@3889 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
46cf77fa79 include precision option for constraint checking, fix some logs, ignore update when constraint change == 0 and error increases 
git-svn-id: http://svn.statmt.org/repository/mira@3888 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
921735593d print out epoch for ignored updates 
git-svn-id: http://svn.statmt.org/repository/mira@3887 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
ecfb8465d4 introduce parameter --nbest-first 
git-svn-id: http://svn.statmt.org/repository/mira@3886 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1f6f8b4abb update training script 
git-svn-id: http://svn.statmt.org/repository/mira@3885 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
479ba8d160 fix bug in options --past-and-current-constraints, --accumulate-most-violated-constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3884 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
bea8af99ff refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight 
git-svn-id: http://svn.statmt.org/repository/mira@3883 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1964eaf98a refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight 
git-svn-id: http://svn.statmt.org/repository/mira@3882 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
53cbedfd28 update hildreth code for linear classifier to work 
git-svn-id: http://svn.statmt.org/repository/mira@3879 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
10abc4fd62 update weighted loss, adapt accumulate-most-violated-constraints and --past-and-current-constraints to batching, accumulate 1 constraint per sentence in batch, additional option for accumulating only 1 constraint per batch --one-per-batch 
git-svn-id: http://svn.statmt.org/repository/mira@3878 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
bc7f8655d6 implement option --one-constraint that uses only the best model translation and the oracle and computes the update analytically 
git-svn-id: http://svn.statmt.org/repository/mira@3877 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
e784b23eac fix case of mixing and weight dump frequency being 0 
git-svn-id: http://svn.statmt.org/repository/mira@3876 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1338ccb718 monitor changes in bleu feature history 
git-svn-id: http://svn.statmt.org/repository/mira@3875 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
b23fcf8143 fix comparison of old vs. new model bleu for batches 
git-svn-id: http://svn.statmt.org/repository/mira@3874 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
bhaddow
e664b4a4b3 Merge 3791-3842 from trunk 
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
ec6272b3fc bleu before and after opt. for batch, print error of constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3872 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
f29d58e3f3 bleu before and after opt. for batch, print error of constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3871 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
6b4a0b442b track the number of violated constraints and constraint changes 
git-svn-id: http://svn.statmt.org/repository/mira@3870 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
16edd0b9bc track the number of violated constraints and constraint changes 
git-svn-id: http://svn.statmt.org/repository/mira@3869 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
ac307d9e8c fix weight dumping for batching 
git-svn-id: http://svn.statmt.org/repository/mira@3868 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
03c5aa5c36 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch' 
git-svn-id: http://svn.statmt.org/repository/mira@3867 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
864ade99a3 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch' 
git-svn-id: http://svn.statmt.org/repository/mira@3866 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
58eb0d0052 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch' 
git-svn-id: http://svn.statmt.org/repository/mira@3865 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
4187e0f691 rename parameter --average-weights 
git-svn-id: http://svn.statmt.org/repository/mira@3864 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
0cbc5b06f4 forgot to check in .h file 
git-svn-id: http://svn.statmt.org/repository/mira@3863 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
cefddaea88 change default values: --control-updates --> true, --accumulate-weights --> false, --distinct-nbest --> true 
git-svn-id: http://svn.statmt.org/repository/mira@3862 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
9ee3edef82 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up 
git-svn-id: http://svn.statmt.org/repository/mira@3861 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
0198fc5e41 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up 
git-svn-id: http://svn.statmt.org/repository/mira@3860 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
ac8b86f0c8 show cache usage and weights 
git-svn-id: http://svn.statmt.org/repository/mira@3859 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00