moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2025-01-03 17:33:52 +03:00
Code Issues Packages Projects Releases Wiki Activity
6,134 Commits 136 Branches 26 Tags 147 MiB
ecfb8465d4
Commit Graph

168 Commits

Author SHA1 Message Date
ehasler
ecfb8465d4 introduce parameter --nbest-first 
git-svn-id: http://svn.statmt.org/repository/mira@3886 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1f6f8b4abb update training script 
git-svn-id: http://svn.statmt.org/repository/mira@3885 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
479ba8d160 fix bug in options --past-and-current-constraints, --accumulate-most-violated-constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3884 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
bea8af99ff refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight 
git-svn-id: http://svn.statmt.org/repository/mira@3883 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1964eaf98a refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight 
git-svn-id: http://svn.statmt.org/repository/mira@3882 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
53cbedfd28 update hildreth code for linear classifier to work 
git-svn-id: http://svn.statmt.org/repository/mira@3879 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
10abc4fd62 update weighted loss, adapt accumulate-most-violated-constraints and --past-and-current-constraints to batching, accumulate 1 constraint per sentence in batch, additional option for accumulating only 1 constraint per batch --one-per-batch 
git-svn-id: http://svn.statmt.org/repository/mira@3878 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
bc7f8655d6 implement option --one-constraint that uses only the best model translation and the oracle and computes the update analytically 
git-svn-id: http://svn.statmt.org/repository/mira@3877 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
e784b23eac fix case of mixing and weight dump frequency being 0 
git-svn-id: http://svn.statmt.org/repository/mira@3876 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1338ccb718 monitor changes in bleu feature history 
git-svn-id: http://svn.statmt.org/repository/mira@3875 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
b23fcf8143 fix comparison of old vs. new model bleu for batches 
git-svn-id: http://svn.statmt.org/repository/mira@3874 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
bhaddow
e664b4a4b3 Merge 3791-3842 from trunk 
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
ec6272b3fc bleu before and after opt. for batch, print error of constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3872 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
f29d58e3f3 bleu before and after opt. for batch, print error of constraints 
git-svn-id: http://svn.statmt.org/repository/mira@3871 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
6b4a0b442b track the number of violated constraints and constraint changes 
git-svn-id: http://svn.statmt.org/repository/mira@3870 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
16edd0b9bc track the number of violated constraints and constraint changes 
git-svn-id: http://svn.statmt.org/repository/mira@3869 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
ac307d9e8c fix weight dumping for batching 
git-svn-id: http://svn.statmt.org/repository/mira@3868 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
03c5aa5c36 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch' 
git-svn-id: http://svn.statmt.org/repository/mira@3867 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
864ade99a3 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch' 
git-svn-id: http://svn.statmt.org/repository/mira@3866 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
58eb0d0052 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch' 
git-svn-id: http://svn.statmt.org/repository/mira@3865 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
4187e0f691 rename parameter --average-weights 
git-svn-id: http://svn.statmt.org/repository/mira@3864 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
0cbc5b06f4 forgot to check in .h file 
git-svn-id: http://svn.statmt.org/repository/mira@3863 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
cefddaea88 change default values: --control-updates --> true, --accumulate-weights --> false, --distinct-nbest --> true 
git-svn-id: http://svn.statmt.org/repository/mira@3862 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
9ee3edef82 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up 
git-svn-id: http://svn.statmt.org/repository/mira@3861 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
0198fc5e41 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up 
git-svn-id: http://svn.statmt.org/repository/mira@3860 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
ac8b86f0c8 show cache usage and weights 
git-svn-id: http://svn.statmt.org/repository/mira@3859 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
56e97a851f change default value for averaging weights to false 
git-svn-id: http://svn.statmt.org/repository/mira@3858 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
61a5d7f511 compare best model score and bleu before and after weight change 
git-svn-id: http://svn.statmt.org/repository/mira@3857 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
2dfe7163b8 fix average moses weights 
git-svn-id: http://svn.statmt.org/repository/mira@3856 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
3b760065ec update 
git-svn-id: http://svn.statmt.org/repository/mira@3855 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
fa661939dd update training script 
git-svn-id: http://svn.statmt.org/repository/mira@3853 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
269f1018c3 introduce option to use average weights for pruning 
git-svn-id: http://svn.statmt.org/repository/mira@3852 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
f6483df41c average approx bleu of best model score translation 
git-svn-id: http://svn.statmt.org/repository/mira@3851 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
62b5fb7f4d introduce parameter --update-after 
git-svn-id: http://svn.statmt.org/repository/mira@3848 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
1630603dce code cleanup 
git-svn-id: http://svn.statmt.org/repository/mira@3847 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
dbd2146188 introduce parameter --update-after-epoch 
git-svn-id: http://svn.statmt.org/repository/mira@3846 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
d04066ee0e introduce parameter --update-after-epoch 
git-svn-id: http://svn.statmt.org/repository/mira@3845 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
41d2d28408 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update, new 
git-svn-id: http://svn.statmt.org/repository/mira@3844 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
f95a9d5d26 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update 
git-svn-id: http://svn.statmt.org/repository/mira@3843 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
9f057c039f adapt BPfactor by 0.05, introduce params for minimum learning rate and minimum sentence update 
git-svn-id: http://svn.statmt.org/repository/mira@3841 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
c41202f2ff fix case when learning rate/max sentence update is 0 
git-svn-id: http://svn.statmt.org/repository/mira@3838 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
b7971689cb adapt BP factor 
git-svn-id: http://svn.statmt.org/repository/mira@3836 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
8139f70df7 introduce parameter --decr-sentence-update 
git-svn-id: http://svn.statmt.org/repository/mira@3835 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
6642a0437c fix reduce.. 
git-svn-id: http://svn.statmt.org/repository/mira@3834 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
ad1812f63a fix weight dumping 
git-svn-id: http://svn.statmt.org/repository/mira@3833 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
7e181ffefd fix weight dumping 
git-svn-id: http://svn.statmt.org/repository/mira@3832 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
8d95753d0c back to dumping cumulative weights, fix learning rate and max-sentence-update 
git-svn-id: http://svn.statmt.org/repository/mira@3831 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
aae83df416 correct file names 
git-svn-id: http://svn.statmt.org/repository/mira@3830 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
6f3506b46b rename parameter --mixing-frequency 
git-svn-id: http://svn.statmt.org/repository/mira@3829 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
9eb2cdee12 rename dev set oracles 
git-svn-id: http://svn.statmt.org/repository/mira@3828 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00