moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2025-01-05 02:22:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
6,540 Commits 136 Branches 26 Tags 147 MiB
4ab2db98fe
Commit Graph

38 Commits

Author SHA1 Message Date
Eva Hasler
4ab2db98fe add parameter --scale-by-x: scale Bleu precision (independent of source/target scaling) 2011-10-24 18:39:23 +01:00
Eva Hasler
e7c8120bf6 new parameter: scale by target length instead of input length 2011-10-24 10:43:53 +01:00
Eva Hasler
7e5b3fa061 calculate length ratios, add +0.1 smoothing and papineni smoothing 2011-10-22 22:23:58 +01:00
Eva Hasler
b263f14f63 this broke something, reverting.. 
Revert "fix LoadReferences() in StaticData and remove reference loading in mira's Main and Decoder"

This reverts commit 2ee9f47a5f.
 2011-10-20 13:43:30 +01:00
Eva Hasler
2ee9f47a5f fix LoadReferences() in StaticData and remove reference loading in mira's Main and Decoder 2011-10-11 17:49:08 +01:00
ehasler
120be1df4f code clean-up, step 1 
git-svn-id: http://svn.statmt.org/repository/mira@3918 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:38 +02:00
ehasler
42333388b4 change verbosity for cerr messages, remove some unwanted options, introduce --margin-slack, --margin-incr 
git-svn-id: http://svn.statmt.org/repository/mira@3913 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
dedd322025 code cleanup 
git-svn-id: http://svn.statmt.org/repository/mira@3902 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
d598fc4c85 print oracle/reference length, implement --core-weights 
git-svn-id: http://svn.statmt.org/repository/mira@3901 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:37 +02:00
ehasler
1964eaf98a refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight 
git-svn-id: http://svn.statmt.org/repository/mira@3882 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
1338ccb718 monitor changes in bleu feature history 
git-svn-id: http://svn.statmt.org/repository/mira@3875 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:36 +02:00
ehasler
0198fc5e41 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up 
git-svn-id: http://svn.statmt.org/repository/mira@3860 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:35 +02:00
ehasler
b7971689cb adapt BP factor 
git-svn-id: http://svn.statmt.org/repository/mira@3836 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
fecfe64d52 Dump weights always after mixing, dump final weights after averaging cumulative weights, stopping criterion related to weights after every epoch 
git-svn-id: http://svn.statmt.org/repository/mira@3825 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
505eba736e introduce parameters --stop-dev-bleu, --stop-approx-dev-bleu 
git-svn-id: http://svn.statmt.org/repository/mira@3822 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
eba945b61c print rank with BLEU 
git-svn-id: http://svn.statmt.org/repository/mira@3810 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
5312e8fc22 compute bleu on oracles translations of dev set, introduce params --min-weight-change, --msf-step, --msf-min, --slack-step, --slack-max, --decoder-settings 
git-svn-id: http://svn.statmt.org/repository/mira@3804 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
391c6806a3 print information separately for each process ('rank 0: ...') 
git-svn-id: http://svn.statmt.org/repository/mira@3799 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
804033bd2c Revert to revision 3774 of public svn + add 0 to weight files < 10 and write 'stoppinDg' file 
git-svn-id: http://svn.statmt.org/repository/mira@3795 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:55:38 +02:00
evahasler
aa2e988132 revert clipping 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3778 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-15 12:53:49 +00:00
evahasler
54824d132f add parameter --ignore-u-weight 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3773 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-14 14:51:04 +00:00
evahasler
2f1b959302 change bleu smoothing, change handling of multiple oracles, parameter for increasing BP 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3770 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-10 16:34:43 +00:00
evahasler
406f55584e introduce parameter --history-smoothing, add mpi_finalize statement 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3752 1f5c12ca-751b-0410-a591-d2e778427230
 2010-12-01 18:09:49 +00:00
evahasler
4af767af60 Introduce parameter --increase-BP 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3742 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-29 14:40:15 +00:00
evahasler
360c03b3bf Introduce parameter --distinct-nbest 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3740 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-29 14:11:19 +00:00
evahasler
1de7aa4f81 enable batch optimisation, batch history updating, fix bug in Decoder.cpp (new: staticData.ReLoadBleuScoreFeatureParameter()) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3734 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-24 17:06:54 +00:00
evahasler
4a6027f7c7 introduce parameter --scale-by-input-length 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3731 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-23 15:59:36 +00:00
evahasler
904329798d introduce arguments --accumulate-weights and --use-scaled-reference 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3727 1f5c12ca-751b-0410-a591-d2e778427230
 2010-11-22 20:36:14 +00:00
evahasler
144d750e33 Fix memory leak in Main.cpp 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3654 1f5c12ca-751b-0410-a591-d2e778427230
 2010-10-25 15:16:34 +00:00
bhaddow
ee04711cf8 update moses weights, references and history for bleu feature 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3528 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 15:17:33 +00:00
bhaddow
1f8bbe3f35 refactoring of hope, fear and model nbest list calculations 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3522 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 14:32:27 +00:00
bhaddow
c52ad1fc22 Most of driver done, need weight updating. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3511 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 12:54:58 +00:00
bhaddow
0d1fb2057e working on driver 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3505 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 10:17:27 +00:00
bhaddow
ff93086924 Force the initialisation of the phrase dictionary 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3499 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 08:33:22 +00:00
hieuhoang1972
c4635251e9 Compileable 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3497 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-17 07:35:31 +00:00
hieuhoang1972
6ed43ab576 output 1 nbest 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3489 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-16 16:23:52 +00:00
bhaddow
c01783869a stubbing out of optimiser 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3463 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-15 15:38:46 +00:00
bhaddow
11143f7511 Start the mira main 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3454 1f5c12ca-751b-0410-a591-d2e778427230
 2010-09-15 14:36:07 +00:00