Commit Graph

373 Commits

Author SHA1 Message Date
Eva Hasler
40135a092f add params --decode-hope, --decode-fear 2012-03-01 12:22:12 +00:00
Eva Hasler
360c5d5d51 dont print out weight vectors 2012-02-29 11:50:17 +00:00
Eva Hasler
75f9d300e9 remove warning.. 2012-02-20 21:22:31 +00:00
Eva Hasler
19f591bb98 add modes 'rank-only' and 'hope-fear-rank' 2012-02-20 20:14:19 +00:00
Eva Hasler
f3daf4fac6 compute model score difference from model scores instead of from feature value difference 2012-02-20 17:27:35 +00:00
Eva Hasler
5e3331311e introduce boost parameter 2012-02-20 15:54:55 +00:00
Eva Hasler
384b7e7598 enable mira learning rate for analytical update 2012-02-19 19:56:16 +00:00
Eva Hasler
46a3d5f909 separate decoder settings for training 2012-02-15 10:52:54 +00:00
Eva Hasler
d35213ba3f remove output of feature value difference 2012-02-14 19:22:29 +00:00
Eva Hasler
8740f7ed81 remove output of feature value difference 2012-02-14 19:15:33 +00:00
Eva Hasler
30cf66d180 remove -mbr parameter from Decoder.cpp 2012-02-14 18:57:47 +00:00
Eva Hasler
a7b4a3848e fix problem with glm feature names 2012-02-14 14:31:26 +00:00
Eva HASLER
b76eb947a0 remove correct-scaling vars 2012-02-03 20:49:43 +00:00
Eva HASLER
eff30fbea8 Merge branch 'miramerge' of thor.inf.ed.ac.uk:/fs/saxnot3/ehasler/mosesdecoder_github_mira into miramerge 2012-02-03 20:21:27 +00:00
Eva HASLER
982e596480 remove --correct-scaling, introduce --min-bleu-ratio 2012-02-03 20:20:25 +00:00
Eva Hasler
c4d9b53390 ignore details 2012-02-01 20:33:57 +00:00
Eva Hasler
e8041f1735 fix --core-weights, remove stabilisation code 2012-02-01 19:47:43 +00:00
Barry Haddow
5a17ef82b3 Merge remote branch 'github/miramerge' into bjam
Conflicts:
	mira/Decoder.h
	mira/Main.cpp
	mira/Main.h
	moses-chart-cmd/src/IOWrapper.cpp
	moses-chart-cmd/src/Main.cpp
	moses-cmd/src/Main.cpp
	moses/src/BleuScoreFeature.cpp
	moses/src/BleuScoreFeature.h
	moses/src/TargetNgramFeature.h
2012-02-01 10:12:16 +00:00
Eva Hasler
960c60c9c6 fix scaling correction.. (hopefully) 2012-01-31 18:14:28 +00:00
Eva
00345b92be add global lexicon model with unlimited scores 2012-01-31 10:31:39 +00:00
Eva HASLER
dcdbed869c fix ref file glob 2012-01-26 13:32:58 +00:00
Eva Hasler
04229893c4 fix MPI statement 2012-01-23 15:51:25 +00:00
Eva Hasler
c06b5f4934 add parameter --correct-scaling 2012-01-23 15:15:27 +00:00
Eva Hasler
709484860e fix delayed updates, analytic update for 1 constraint 2012-01-23 12:22:12 +00:00
Barry Haddow
1e10bb7ef7 Merge from miramerge.
Reverted ChartHypothesis as it breaks chart-decoding.
2012-01-20 15:35:55 +00:00
Eva HASLER
f4aba433b4 add parameter --min-oracle-bleu, rename method 2012-01-16 16:11:02 +00:00
Eva Hasler
7c9f59fee3 update example selection 2012-01-16 16:08:56 +00:00
Eva Hasler
f989267b6c fix reference length selection/collection of ngrams for multiple references 2012-01-16 11:22:58 +00:00
Eva Hasler
a050992abd add parameter --delay-updates 2012-01-14 15:56:16 +00:00
Eva HASLER
1551f44879 Merge branch 'miramerge' of thor.inf.ed.ac.uk:/fs/saxnot3/ehasler/mosesdecoder_github_mira into miramerge 2012-01-12 16:31:17 +00:00
Eva HASLER
ebf6dd938d fix for using multiple reference translations with mira 2012-01-12 16:30:50 +00:00
Eva Hasler
b18f3cbd86 Merge branch 'miramerge' of thor.inf.ed.ac.uk:/fs/saxnot3/ehasler/mosesdecoder_github_mira into miramerge 2012-01-12 16:28:29 +00:00
Eva Hasler
e1f6db3438 add parameter --stabilise-length 2012-01-12 16:26:16 +00:00
Eva HASLER
cf8ab0f92f check existence of reference stems 2012-01-11 13:50:33 +00:00
Eva Hasler
24887b40f0 define L-infinity norm (fixes bug in mira after changes in FeatureVector) 2011-12-23 10:55:54 +00:00
Barry Haddow
fde9c37b26 enable mpi support 2011-12-15 21:54:56 +00:00
Barry Haddow
a64bba48ad Add moses and mira unit tests to bjam build. 2011-12-15 12:36:07 +00:00
Barry Haddow
b2c1e97a53 mira now builds with bjam 2011-12-15 11:30:58 +00:00
Eva Hasler
6f0cc81aa4 scale by target (linear/trend) 2011-11-25 15:54:32 +00:00
Eva Hasler
15091ab70c fix ApplyLog() --> LogCoreFeatures() 2011-11-25 13:56:55 +00:00
Eva Hasler
f86337b2a9 add scaling by target length 2011-11-24 16:35:29 +00:00
Barry Haddow
d57d0c0656 Merge branch 'master' into miramerge
Conflicts:
	Makefile.am
	config.h.in
	configure.in
	kenlm
	moses-chart-cmd/src/IOWrapper.cpp
	moses/src/Parameter.cpp
	scripts/Makefile
2011-11-17 17:46:17 +00:00
Eva Hasler
4d01fec508 fix: set Bleu feature to zero; do not dump weights on epoch without updates 2011-11-17 16:31:46 +00:00
Eva
9d69bc4dcf add parameter to relax brevity penalty 2011-11-16 19:06:14 +01:00
Eva Hasler
f54b3d878c fix decoder settings 2011-11-16 12:25:26 +00:00
Eva
02bf6b2818 fix mira after changes to FeatureVector, fix saving and clearing of core features 2011-11-16 10:13:17 +01:00
Eva Hasler
28f22147d4 separate max deviation between hypos and wrt reference 2011-10-27 16:37:10 +01:00
Eva Hasler
860beea845 maximum length deviation: change >= to > 2011-10-27 15:28:28 +01:00
Eva Hasler
7bbcc67344 scale by average of source and reference length (--scale-by-avg-length) 2011-10-26 11:36:00 +01:00
Eva Hasler
7d0a5fa11f scale Bleu by complete source length or reference length 2011-10-26 11:16:45 +01:00
Eva HASLER
f56dd2ae1d output length ratio.. 2011-10-26 10:44:06 +01:00
Eva Hasler
52f8dcb8fc add length-based example selection (--max-length-deviation) 2011-10-25 15:17:00 +01:00
Eva Hasler
4ab2db98fe add parameter --scale-by-x: scale Bleu precision (independent of source/target scaling) 2011-10-24 18:39:23 +01:00
Eva Hasler
1d6498e8ed compute absolute diff between hope and fear length 2011-10-24 11:20:34 +01:00
Eva Hasler
e7c8120bf6 new parameter: scale by target length instead of input length 2011-10-24 10:43:53 +01:00
Eva Hasler
70806af16c Merge branch 'miramerge' of thor.inf.ed.ac.uk:/fs/saxnot3/ehasler/mosesdecoder_git_mira into miramerge 2011-10-22 22:25:02 +01:00
Eva Hasler
7e5b3fa061 calculate length ratios, add +0.1 smoothing and papineni smoothing 2011-10-22 22:23:58 +01:00
Eva HASLER
3bded27f44 Merge branch 'miramerge' of thor.inf.ed.ac.uk:/fs/saxnot3/ehasler/mosesdecoder_git_mira into miramerge 2011-10-20 17:14:43 +01:00
Eva HASLER
01621ebdaf adapt training file 2011-10-20 17:14:01 +01:00
Eva Hasler
569b027ec0 add param -mp to decoding options in expt.cfg 2011-10-20 17:02:38 +01:00
Eva Hasler
c89881fc44 change order of hope and model translation calls 2011-10-20 15:03:32 +01:00
Eva Hasler
c60dd49162 introduce separate bleu-score-weight for hope translations 2011-10-20 15:02:21 +01:00
Eva Hasler
eebfd61e48 re-apply changes unrelated to setting reference translations 2011-10-20 14:32:05 +01:00
Eva Hasler
b263f14f63 this broke something, reverting..
Revert "fix LoadReferences() in StaticData and remove reference loading in mira's Main and Decoder"

This reverts commit 2ee9f47a5f.
2011-10-20 13:43:30 +01:00
Eva Hasler
51b54e0d9d Merge branch 'miramerge' of thor.inf.ed.ac.uk:/fs/saxnot3/ehasler/mosesdecoder_git_mira into miramerge 2011-10-11 18:10:00 +01:00
Eva Hasler
2ee9f47a5f fix LoadReferences() in StaticData and remove reference loading in mira's Main and Decoder 2011-10-11 17:49:08 +01:00
Eva HASLER
e152ee7790 update training file and config 2011-09-27 12:36:14 +01:00
Eva Hasler
1e9e313b62 cleanup 2011-09-26 18:31:59 +01:00
Eva Hasler
2dd9e4cc7c change sample config file 2011-08-30 15:24:51 +01:00
bhaddow
43c7c087ba remove moses-chart/src from makefile 2011-08-25 18:59:06 +01:00
ehasler
37c4d48ce5 delete files
git-svn-id: http://svn.statmt.org/repository/mira@3924 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
cd63771ca4 update parameters --scale-margin and --scale-update
git-svn-id: http://svn.statmt.org/repository/mira@3923 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
f658840f1a refactorings, remove burn-in code
git-svn-id: http://svn.statmt.org/repository/mira@3922 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
290e38fb73 fix perceptron option
git-svn-id: http://svn.statmt.org/repository/mira@3921 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
1dd2f297c4 move definitions to Main.h, some new methods
git-svn-id: http://svn.statmt.org/repository/mira@3920 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
33ac94bde2 move definitions to Main.h, some new methods
git-svn-id: http://svn.statmt.org/repository/mira@3919 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
120be1df4f code clean-up, step 1
git-svn-id: http://svn.statmt.org/repository/mira@3918 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
8e6c963041 update training script and sample config file
git-svn-id: http://svn.statmt.org/repository/mira@3917 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
512cf2c76b --history-of-oracles and --history-of-1best: if none is selected and history in use, use 1best
git-svn-id: http://svn.statmt.org/repository/mira@3916 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
7dc3836cd3 introduce parameter --adapt-after-epoch
git-svn-id: http://svn.statmt.org/repository/mira@3915 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:38 +02:00
ehasler
42333388b4 change verbosity for cerr messages, remove some unwanted options, introduce --margin-slack, --margin-incr
git-svn-id: http://svn.statmt.org/repository/mira@3913 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
a4cc2efbe5 do not skip_submit by default
git-svn-id: http://svn.statmt.org/repository/mira@3911 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
29cb9271e6 enable only creating but not submitting test jobs
git-svn-id: http://svn.statmt.org/repository/mira@3910 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
14a0d2c8da enable target bigrams of POS tags
git-svn-id: http://svn.statmt.org/repository/mira@3909 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
4e0f848d50 remove multiple oracles, remove accumulating constraints
git-svn-id: http://svn.statmt.org/repository/mira@3908 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
72da32f0cb update training script
git-svn-id: http://svn.statmt.org/repository/mira@3907 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
c0bb177791 enable margin scaling and update scaling with oracle bleu; remove fixed margin scaling
git-svn-id: http://svn.statmt.org/repository/mira@3906 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
c8c3f763ec fix setting core features for multi-score features
git-svn-id: http://svn.statmt.org/repository/mira@3905 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
5c4be22240 remove bug in updateWeightsHopeFear()
git-svn-id: http://svn.statmt.org/repository/mira@3904 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
09def6be90 change param dependencies
git-svn-id: http://svn.statmt.org/repository/mira@3903 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
dedd322025 code cleanup
git-svn-id: http://svn.statmt.org/repository/mira@3902 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
d598fc4c85 print oracle/reference length, implement --core-weights
git-svn-id: http://svn.statmt.org/repository/mira@3901 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
ccb4cf0fb2 add m_precision to modelScoreDiff
git-svn-id: http://svn.statmt.org/repository/mira@3900 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
0280af11dd Fix vector initialisation, comments
git-svn-id: http://svn.statmt.org/repository/mira@3899 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
f431ea0557 Fix vector initialisation
git-svn-id: http://svn.statmt.org/repository/mira@3898 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
020c71216b For hope-fear option, add only constraints between hope and fear translations, not between hope translations. Make hope-fear sizes flexible with --hope-n and --fear-n
git-svn-id: http://svn.statmt.org/repository/mira@3897 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
a177b58d18 set precision to 0, set hope-fear to 1, dont add constraints for equal translations
git-svn-id: http://svn.statmt.org/repository/mira@3896 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
cda08ac2e3 fix problem with analytical update
git-svn-id: http://svn.statmt.org/repository/mira@3895 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
1da0544d77 enable 1best history for perceptron/analytical update
git-svn-id: http://svn.statmt.org/repository/mira@3894 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
86dba9f743 default: stop when weights converge
git-svn-id: http://svn.statmt.org/repository/mira@3892 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
a1d2252529 enable perceptron update with only 1 hope and fear translation each
git-svn-id: http://svn.statmt.org/repository/mira@3891 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
a58dd23b03 remove stop-optimal parameter, default for precision is 1.0, fix flexible slack, inable analytical update
git-svn-id: http://svn.statmt.org/repository/mira@3890 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:37 +02:00
ehasler
bc2a2078ea add 1best decoding after optimization for --updates-per-epoch option
git-svn-id: http://svn.statmt.org/repository/mira@3889 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
46cf77fa79 include precision option for constraint checking, fix some logs, ignore update when constraint change == 0 and error increases
git-svn-id: http://svn.statmt.org/repository/mira@3888 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
921735593d print out epoch for ignored updates
git-svn-id: http://svn.statmt.org/repository/mira@3887 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
ecfb8465d4 introduce parameter --nbest-first
git-svn-id: http://svn.statmt.org/repository/mira@3886 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
1f6f8b4abb update training script
git-svn-id: http://svn.statmt.org/repository/mira@3885 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
479ba8d160 fix bug in options --past-and-current-constraints, --accumulate-most-violated-constraints
git-svn-id: http://svn.statmt.org/repository/mira@3884 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
bea8af99ff refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight
git-svn-id: http://svn.statmt.org/repository/mira@3883 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
1964eaf98a refactor handling of accumulated constraints, constraint checking, introduce burn-in for bleu history, sentence-level bleu, bleu score weight
git-svn-id: http://svn.statmt.org/repository/mira@3882 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
53cbedfd28 update hildreth code for linear classifier to work
git-svn-id: http://svn.statmt.org/repository/mira@3879 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
10abc4fd62 update weighted loss, adapt accumulate-most-violated-constraints and --past-and-current-constraints to batching, accumulate 1 constraint per sentence in batch, additional option for accumulating only 1 constraint per batch --one-per-batch
git-svn-id: http://svn.statmt.org/repository/mira@3878 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
bc7f8655d6 implement option --one-constraint that uses only the best model translation and the oracle and computes the update analytically
git-svn-id: http://svn.statmt.org/repository/mira@3877 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
e784b23eac fix case of mixing and weight dump frequency being 0
git-svn-id: http://svn.statmt.org/repository/mira@3876 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
1338ccb718 monitor changes in bleu feature history
git-svn-id: http://svn.statmt.org/repository/mira@3875 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
b23fcf8143 fix comparison of old vs. new model bleu for batches
git-svn-id: http://svn.statmt.org/repository/mira@3874 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
bhaddow
e664b4a4b3 Merge 3791-3842 from trunk
git-svn-id: http://svn.statmt.org/repository/mira@3873 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
ec6272b3fc bleu before and after opt. for batch, print error of constraints
git-svn-id: http://svn.statmt.org/repository/mira@3872 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
f29d58e3f3 bleu before and after opt. for batch, print error of constraints
git-svn-id: http://svn.statmt.org/repository/mira@3871 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
6b4a0b442b track the number of violated constraints and constraint changes
git-svn-id: http://svn.statmt.org/repository/mira@3870 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
16edd0b9bc track the number of violated constraints and constraint changes
git-svn-id: http://svn.statmt.org/repository/mira@3869 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
ac307d9e8c fix weight dumping for batching
git-svn-id: http://svn.statmt.org/repository/mira@3868 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
03c5aa5c36 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch'
git-svn-id: http://svn.statmt.org/repository/mira@3867 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:36 +02:00
ehasler
864ade99a3 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch'
git-svn-id: http://svn.statmt.org/repository/mira@3866 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
58eb0d0052 sanity check for updates-per-epoch, stopping criterion 'sum of updates this epoch'
git-svn-id: http://svn.statmt.org/repository/mira@3865 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
4187e0f691 rename parameter --average-weights
git-svn-id: http://svn.statmt.org/repository/mira@3864 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
0cbc5b06f4 forgot to check in .h file
git-svn-id: http://svn.statmt.org/repository/mira@3863 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
cefddaea88 change default values: --control-updates --> true, --accumulate-weights --> false, --distinct-nbest --> true
git-svn-id: http://svn.statmt.org/repository/mira@3862 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
9ee3edef82 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up
git-svn-id: http://svn.statmt.org/repository/mira@3861 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
0198fc5e41 add Hildreth unit tests, fix consstraint comparison in MiraOptimiser, some code clean-up
git-svn-id: http://svn.statmt.org/repository/mira@3860 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
ac8b86f0c8 show cache usage and weights
git-svn-id: http://svn.statmt.org/repository/mira@3859 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
56e97a851f change default value for averaging weights to false
git-svn-id: http://svn.statmt.org/repository/mira@3858 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
61a5d7f511 compare best model score and bleu before and after weight change
git-svn-id: http://svn.statmt.org/repository/mira@3857 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
2dfe7163b8 fix average moses weights
git-svn-id: http://svn.statmt.org/repository/mira@3856 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
3b760065ec update
git-svn-id: http://svn.statmt.org/repository/mira@3855 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
fa661939dd update training script
git-svn-id: http://svn.statmt.org/repository/mira@3853 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
269f1018c3 introduce option to use average weights for pruning
git-svn-id: http://svn.statmt.org/repository/mira@3852 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
f6483df41c average approx bleu of best model score translation
git-svn-id: http://svn.statmt.org/repository/mira@3851 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
62b5fb7f4d introduce parameter --update-after
git-svn-id: http://svn.statmt.org/repository/mira@3848 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
1630603dce code cleanup
git-svn-id: http://svn.statmt.org/repository/mira@3847 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
dbd2146188 introduce parameter --update-after-epoch
git-svn-id: http://svn.statmt.org/repository/mira@3846 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
d04066ee0e introduce parameter --update-after-epoch
git-svn-id: http://svn.statmt.org/repository/mira@3845 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
41d2d28408 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update, new
git-svn-id: http://svn.statmt.org/repository/mira@3844 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
f95a9d5d26 update training script to compute BLEU of dev set, update computation of dev bleu (on best model score translation), check best model scores after weight update
git-svn-id: http://svn.statmt.org/repository/mira@3843 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:35 +02:00
ehasler
9f057c039f adapt BPfactor by 0.05, introduce params for minimum learning rate and minimum sentence update
git-svn-id: http://svn.statmt.org/repository/mira@3841 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
c41202f2ff fix case when learning rate/max sentence update is 0
git-svn-id: http://svn.statmt.org/repository/mira@3838 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
b7971689cb adapt BP factor
git-svn-id: http://svn.statmt.org/repository/mira@3836 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
8139f70df7 introduce parameter --decr-sentence-update
git-svn-id: http://svn.statmt.org/repository/mira@3835 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
6642a0437c fix reduce..
git-svn-id: http://svn.statmt.org/repository/mira@3834 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00
ehasler
ad1812f63a fix weight dumping
git-svn-id: http://svn.statmt.org/repository/mira@3833 cc96ff50-19ce-11e0-b349-13d7f0bd23df
2011-08-18 12:59:34 +02:00