Commit Graph

2146 Commits

Author SHA1 Message Date
evahasler
fbc8910102 reintroduce clipping
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3772 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-14 12:17:17 +00:00
evahasler
da95cb2560 compute error only for rank 0
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3771 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-13 18:10:17 +00:00
evahasler
2f1b959302 change bleu smoothing, change handling of multiple oracles, parameter for increasing BP
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3770 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-10 16:34:43 +00:00
evahasler
cd62ffc021 mpi abort, compute error over fixed set of ex., add params --suppress-convergence and --past-and-current-constraints
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3766 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-09 18:55:52 +00:00
evahasler
7c238b6b44 add parameters --accumulate-oracles and --accumulate-most-violated-constraints
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3765 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-09 11:49:52 +00:00
evahasler
0c70c1a4ef introduce weighted loss function
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3761 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-06 19:32:59 +00:00
evahasler
47d91e8b93 Introduce stopping criterion based on changes in average total weights
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3760 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-06 15:28:51 +00:00
evahasler
87141f9f89 debug code
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3758 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-02 18:27:21 +00:00
evahasler
b852fb6763 add scripts
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3757 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-02 10:22:50 +00:00
evahasler
5c96b2d07d test
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3756 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-02 10:22:12 +00:00
evahasler
fc64a41495 update training script
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3755 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-01 18:51:19 +00:00
evahasler
2ee9e26104 typo
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3754 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-01 18:21:58 +00:00
evahasler
cd12923603 typo
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3753 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-01 18:13:52 +00:00
evahasler
406f55584e introduce parameter --history-smoothing, add mpi_finalize statement
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3752 1f5c12ca-751b-0410-a591-d2e778427230
2010-12-01 18:09:49 +00:00
evahasler
da712f0eeb change return type from size_t to int
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3751 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-30 17:26:34 +00:00
evahasler
13dd3b282c increase BP
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3748 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 21:12:46 +00:00
evahasler
859483640f fix batching
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3747 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 19:09:34 +00:00
evahasler
628c2380a9 add parameter --regularise-hildreth-updates
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3746 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 18:42:18 +00:00
evahasler
e442c513dd sanity check number of violated constraint/overall change in objective
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3743 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 15:07:38 +00:00
evahasler
4af767af60 Introduce parameter --increase-BP
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3742 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 14:40:15 +00:00
evahasler
2feabd94fc Introduce parameter --distinct-nbest
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3741 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 14:13:45 +00:00
evahasler
360c03b3bf Introduce parameter --distinct-nbest
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3740 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-29 14:11:19 +00:00
evahasler
e7d3ddb358 disable mpi finalize (not working)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3735 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-24 17:28:08 +00:00
evahasler
1de7aa4f81 enable batch optimisation, batch history updating, fix bug in Decoder.cpp (new: staticData.ReLoadBleuScoreFeatureParameter())
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3734 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-24 17:06:54 +00:00
evahasler
97b7e1401e delete fear translations
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3733 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-23 16:20:26 +00:00
evahasler
8cd6d2c34a delete fear translations
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3732 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-23 16:17:35 +00:00
evahasler
4a6027f7c7 introduce parameter --scale-by-input-length
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3731 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-23 15:59:36 +00:00
evahasler
8de8773b39 fix averaging of cumulative weights
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3730 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-23 15:11:32 +00:00
evahasler
904329798d introduce arguments --accumulate-weights and --use-scaled-reference
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3727 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-22 20:36:14 +00:00
evahasler
a25bbecd76 update smo
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3722 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-19 11:35:16 +00:00
evahasler
53b61425d5 add fixed clipping for smo
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3721 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-18 16:24:51 +00:00
evahasler
93ff481caa add parameter for size of nbest lists and for adding constraints
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3717 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-16 18:52:08 +00:00
evahasler
81088c8f30 Introduce margin scale factor, change printing of feature vectors
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3716 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-16 12:11:00 +00:00
evahasler
57b0e64cda Introduce margin scale factor, change printing of feature vectors
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3715 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-16 11:44:44 +00:00
evahasler
ffc37e64b3 normalize weights after mixing
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3707 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-12 15:40:53 +00:00
evahasler
590ad17713 normalize weights after mixing
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3706 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-12 15:35:10 +00:00
evahasler
7bc6318270 normalize weights after mixing
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3705 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-12 15:22:28 +00:00
evahasler
74cd65c24a update
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3693 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-09 17:37:10 +00:00
evahasler
7af072ace0 remove clipping from updateWeights(), update Main
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3692 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-09 17:31:30 +00:00
bhaddow
842c9f4cb6 Add boost mpi macros
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3685 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-02 15:08:31 +00:00
evahasler
9697b152be all to cerr
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3684 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-01 16:56:10 +00:00
evahasler
f17a6c6809 fix hildreth
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3683 1f5c12ca-751b-0410-a591-d2e778427230
2010-11-01 12:30:49 +00:00
evahasler
acc6ac21dc fix loop
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3681 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-29 17:36:16 +00:00
evahasler
08981b87f0 add Hildreth algorithm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3680 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-29 15:42:50 +00:00
evahasler
8f00469259 add Hildreth algorithm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3679 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-29 15:41:37 +00:00
bhaddow
179572c83a experiment script
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3678 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-28 16:20:57 +00:00
bhaddow
68d5f4469d weight dumping
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3677 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-28 12:41:33 +00:00
evahasler
17358fd834 sanity check for margin
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3676 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-28 10:00:35 +00:00
evahasler
144d750e33 Fix memory leak in Main.cpp
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3654 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-25 15:16:34 +00:00
evahasler
85a71793a6 Update mira optimatization code and merge Main.cpp
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3652 1f5c12ca-751b-0410-a591-d2e778427230
2010-10-25 12:22:35 +00:00