Commit Graph

68 Commits

Author SHA1 Message Date
Hieu Hoang
6249432407 beautify 2013-05-29 18:16:15 +01:00
Hieu Hoang
a80d838b0f move feature functions into moses/FF 2013-05-24 18:02:49 +01:00
Hieu Hoang
981351758a delete class TranslationSystem 2013-05-11 14:13:26 +01:00
Hieu Hoang
065597dc9f only include moses root when compiling 2012-11-14 14:18:53 +00:00
Eva Hasler
ebbf0d028c changes to mira, adding jackknife to experiment.perl 2012-10-01 20:36:52 +01:00
Eva Hasler
6a6a35c65e fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
Eva
62d10a2af3 implement CalculateBleu for complete translations, add parameters --disable-bleu-feature and --real-bleu to replace dynamic sentence Bleu with real sentence Bleu 2012-05-29 17:04:36 -07:00
Eva
29b31f6cd9 remove <s> and </s> from chart bleu score computation 2012-05-28 15:49:39 -07:00
Eva Hasler
30deedde9f changed permission, everything changed.. 2012-05-10 18:54:24 +01:00
Eva
6f39ad0b3e test 2012-04-28 23:11:30 -07:00
Eva Hasler
ef552fe91a remove caching of wp weight and translation weights, clean up mira code 2012-04-29 05:37:48 +01:00
Eva Hasler
9587b7be5b fix cleanup() 2012-04-02 14:31:57 +01:00
Eva Hasler
1b1459283c Implement EvaluateChart for BleuScoreFeature, add mira parameter --avg-ref-length (either shortest or average reference length), clean up CalculateBleu(..), clean up Decoder.cpp 2012-04-01 19:59:00 +01:00
Eva Hasler
1fab532bd0 add parameter --print-feature-info 1, start adding megam support.. --megam 2012-03-29 19:44:16 +01:00
Eva Hasler
f5a4d61fd4 resolving conflicts 2012-03-27 14:24:49 +01:00
Eva Hasler
4a1e7fd07d fix history Bleu and add parameter --use-source-length-history 2012-03-15 18:43:08 +00:00
Eva
bdfedb34f2 change history Bleu, add scaling option for sentence Bleu 2012-03-12 19:59:10 +00:00
Eva Hasler
607119cacd add option --scale-by-inverse-length 2012-03-07 17:43:15 +00:00
Eva Hasler
36c5946f0d enable nbest hope/fear decoding 2012-03-01 17:42:59 +00:00
Eva Hasler
f3daf4fac6 compute model score difference from model scores instead of from feature value difference 2012-02-20 17:27:35 +00:00
Barry Haddow
5a17ef82b3 Merge remote branch 'github/miramerge' into bjam
Conflicts:
	mira/Decoder.h
	mira/Main.cpp
	mira/Main.h
	moses-chart-cmd/src/IOWrapper.cpp
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/Main.cpp
	moses/src/BleuScoreFeature.cpp
	moses/src/BleuScoreFeature.h
	moses/src/TargetNgramFeature.h
2012-02-01 10:12:16 +00:00
Eva Hasler
c06b5f4934 add parameter --correct-scaling 2012-01-23 15:15:27 +00:00
Barry Haddow
1e10bb7ef7 Merge from miramerge.
Reverted ChartHypothesis as it breaks chart-decoding.
2012-01-20 15:35:55 +00:00
Eva Hasler
f989267b6c fix reference length selection/collection of ngrams for multiple references 2012-01-16 11:22:58 +00:00
Eva Hasler
e1f6db3438 add parameter --stabilise-length 2012-01-12 16:26:16 +00:00
Eva Hasler
6f0cc81aa4 scale by target (linear/trend) 2011-11-25 15:54:32 +00:00
Eva Hasler
f86337b2a9 add scaling by target length 2011-11-24 16:35:29 +00:00
Eva
9d69bc4dcf add parameter to relax brevity penalty 2011-11-16 19:06:14 +01:00
Eva
02bf6b2818 fix mira after changes to FeatureVector, fix saving and clearing of core features 2011-11-16 10:13:17 +01:00
Eva Hasler
7bbcc67344 scale by average of source and reference length (--scale-by-avg-length) 2011-10-26 11:36:00 +01:00
Eva Hasler
4ab2db98fe add parameter --scale-by-x: scale Bleu precision (independent of source/target scaling) 2011-10-24 18:39:23 +01:00
Eva Hasler
e7c8120bf6 new parameter: scale by target length instead of input length 2011-10-24 10:43:53 +01:00
Eva Hasler
7e5b3fa061 calculate length ratios, add +0.1 smoothing and papineni smoothing 2011-10-22 22:23:58 +01:00
Eva Hasler
b263f14f63 this broke something, reverting..
Revert "fix LoadReferences() in StaticData and remove reference loading in mira's Main and Decoder"

This reverts commit 2ee9f47a5f.
2011-10-20 13:43:30 +01:00
Eva Hasler
2ee9f47a5f fix LoadReferences() in StaticData and remove reference loading in mira's Main and Decoder 2011-10-11 17:49:08 +01:00
ehasler
120be1df4f code clean-up, step 1
git-svn-id: http://svn.statmt.org/repository/mira@3918 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
42333388b4 change verbosity for cerr messages, remove some unwanted options, introduce --margin-slack, --margin-incr
git-svn-id: http://svn.statmt.org/repository/mira@3913 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
dedd322025 code cleanup
git-svn-id: http://svn.statmt.org/repository/mira@3902 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
d598fc4c85 print oracle/reference length, implement --core-weights
git-svn-id: http://svn.statmt.org/repository/mira@3901 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
1964eaf98a refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight
git-svn-id: http://svn.statmt.org/repository/mira@3882 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
1338ccb718 monitor changes in bleu feature history
git-svn-id: http://svn.statmt.org/repository/mira@3875 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
0198fc5e41 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up
git-svn-id: http://svn.statmt.org/repository/mira@3860 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
b7971689cb adapt BP factor
git-svn-id: http://svn.statmt.org/repository/mira@3836 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
fecfe64d52 Dump weights always after mixing, dump final weights after averaging cumulative weights, stopping criterion related to weights after every epoch
git-svn-id: http://svn.statmt.org/repository/mira@3825 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
505eba736e introduce parameters --stop-dev-bleu, --stop-approx-dev-bleu
git-svn-id: http://svn.statmt.org/repository/mira@3822 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
eba945b61c print rank with BLEU
git-svn-id: http://svn.statmt.org/repository/mira@3810 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:33 +02:00
ehasler
5312e8fc22 compute bleu on oracles translations of dev set, introduce params --min-weight-change, --msf-step, --msf-min, --slack-step, --slack-max, --decoder-settings
git-svn-id: http://svn.statmt.org/repository/mira@3804 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:33 +02:00
ehasler
391c6806a3 print information separately for each process ('rank 0: ...')
git-svn-id: http://svn.statmt.org/repository/mira@3799 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:33 +02:00
ehasler
804033bd2c Revert to revision 3774 of public svn + add 0 to weight files < 10 and write 'stoppinDg' file
git-svn-id: http://svn.statmt.org/repository/mira@3795 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:55:38 +02:00
evahasler
aa2e988132 revert clipping
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3778 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-15 12:53:49 +00:00