moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-11-10 10:59:21 +03:00
Code Issues Packages Projects Releases Wiki Activity
6,084 Commits 136 Branches 26 Tags 147 MiB
b7971689cb
Commit Graph

6084 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
ehasler
b7971689cb adapt BP factor 
git-svn-id: http://svn.statmt.org/repository/mira@3836 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
8139f70df7 introduce parameter --decr-sentence-update 
git-svn-id: http://svn.statmt.org/repository/mira@3835 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
6642a0437c fix reduce.. 
git-svn-id: http://svn.statmt.org/repository/mira@3834 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
ad1812f63a fix weight dumping 
git-svn-id: http://svn.statmt.org/repository/mira@3833 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
7e181ffefd fix weight dumping 
git-svn-id: http://svn.statmt.org/repository/mira@3832 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
8d95753d0c back to dumping cumulative weights, fix learning rate and max-sentence-update 
git-svn-id: http://svn.statmt.org/repository/mira@3831 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
aae83df416 correct file names 
git-svn-id: http://svn.statmt.org/repository/mira@3830 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
6f3506b46b rename parameter --mixing-frequency 
git-svn-id: http://svn.statmt.org/repository/mira@3829 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
9eb2cdee12 rename dev set oracles 
git-svn-id: http://svn.statmt.org/repository/mira@3828 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
377bd27b36 use total weights for convergence check, dump total weights after every epoch 
git-svn-id: http://svn.statmt.org/repository/mira@3827 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
3906510611 closing bracket.. 
git-svn-id: http://svn.statmt.org/repository/mira@3826 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
fecfe64d52 Dump weights always after mixing, dump final weights after averaging cumulative weights, stopping criterion related to weights after every epoch 
git-svn-id: http://svn.statmt.org/repository/mira@3825 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
8bfb25f703 change default for --accumulate-weights to true 
git-svn-id: http://svn.statmt.org/repository/mira@3824 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
ffcd03dd51 change max-sentence-update to scale weights instead of clipping them, fix mpi commands 
git-svn-id: http://svn.statmt.org/repository/mira@3823 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
505eba736e introduce parameters --stop-dev-bleu, --stop-approx-dev-bleu 
git-svn-id: http://svn.statmt.org/repository/mira@3822 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
a26a38533b code cleanup 
git-svn-id: http://svn.statmt.org/repository/mira@3821 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
512674dacb change default value for slack to 0.01 
git-svn-id: http://svn.statmt.org/repository/mira@3820 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
75565119d2 introduce parameters --max-sentence-update, --check-updates, --decr-learning-rate, change some default values, code cleanup 
git-svn-id: http://svn.statmt.org/repository/mira@3819 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
691d1bcb48 update training script not to do normalisation 
git-svn-id: http://svn.statmt.org/repository/mira@3818 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:34 +02:00
ehasler
e81a7e6da1 optional normalisation at start 
git-svn-id: http://svn.statmt.org/repository/mira@3817 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
a049734fd6 print oracles for rank0 when stopping 
git-svn-id: http://svn.statmt.org/repository/mira@3816 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
ca7b28155c update of printing dev oracles, parameter for printing feature values 
git-svn-id: http://svn.statmt.org/repository/mira@3815 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
b44f1447cd write oracle translation to file 
git-svn-id: http://svn.statmt.org/repository/mira@3814 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
0722b78c0d introduce parameter --normalise 
git-svn-id: http://svn.statmt.org/repository/mira@3813 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
bhaddow
3348dcd03e Configurable factor id for target bigram 
git-svn-id: http://svn.statmt.org/repository/mira@3812 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
9b3c9a6fd6 fix handling of large memory jobs 
git-svn-id: http://svn.statmt.org/repository/mira@3811 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
eba945b61c print rank with BLEU 
git-svn-id: http://svn.statmt.org/repository/mira@3810 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
7ceae4581a return unaltered state if no new words are translated 
git-svn-id: http://svn.statmt.org/repository/mira@3809 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
0993dde7ce fix precision 
git-svn-id: http://svn.statmt.org/repository/mira@3808 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
eeba3547cd change default: --dev-bleu 1 
git-svn-id: http://svn.statmt.org/repository/mira@3807 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
fbcc9e1401 update script to pass on decoder settings 
git-svn-id: http://svn.statmt.org/repository/mira@3806 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
2f54b8f61f remove smoothing from function CalculateBleuOfCorpus 
git-svn-id: http://svn.statmt.org/repository/mira@3805 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
5312e8fc22 compute bleu on oracles translations of dev set, introduce params --min-weight-change, --msf-step, --msf-min, --slack-step, --slack-max, --decoder-settings 
git-svn-id: http://svn.statmt.org/repository/mira@3804 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
c4acd339fd enable second language model 
git-svn-id: http://svn.statmt.org/repository/mira@3803 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
0db01446b7 fix bug introduced in last CL 
git-svn-id: http://svn.statmt.org/repository/mira@3802 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
df66bf2816 extend lexical reordering component to allow for more weights 
git-svn-id: http://svn.statmt.org/repository/mira@3801 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
c911b44ac3 comment printing of weights, change mpi quitting, several changes to training script 
git-svn-id: http://svn.statmt.org/repository/mira@3800 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
391c6806a3 print information separately for each process ('rank 0: ...') 
git-svn-id: http://svn.statmt.org/repository/mira@3799 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
606355deba Enable taking logs of feature values 
git-svn-id: http://svn.statmt.org/repository/mira@3798 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
8309fa8dd7 update scripts training-expt.perl, extractInformation.perl, mapWeightsToIni.perl 
git-svn-id: http://svn.statmt.org/repository/mira@3797 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:59:33 +02:00
ehasler
93797cb5eb add test for Hildreth functions 
git-svn-id: http://svn.statmt.org/repository/mira@3796 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:58:52 +02:00
ehasler
804033bd2c Revert to revision 3774 of public svn + add 0 to weight files < 10 and write 'stoppinDg' file 
git-svn-id: http://svn.statmt.org/repository/mira@3795 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:55:38 +02:00
bhaddow
c89700f52c removed 
git-svn-id: http://svn.statmt.org/repository/mira@3794 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-08-18 12:54:53 +02:00
Ondrej Bojar
7b294d1eb0 Merge commit '1a40c7bf7779adb94af2d85d7014ae87c2f9fe07' into miramerge 
All the conflicts were actually fake, both version of each of the files were
identical.

Conflicts:
	scripts/ems/support/split-sentences.perl
	scripts/other/beautify.perl
	scripts/training/train-global-lexicon-model.perl
	scripts/training/wrappers/filter-excluded-lines.perl
	scripts/training/wrappers/find-unparseable.perl
	scripts/training/wrappers/make-factor-suffix.perl
 2011-08-18 12:49:41 +02:00
bhaddow
1a40c7bf77 moved up 
git-svn-id: http://svn.statmt.org/repository/mira@3793 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-01-06 22:20:53 +00:00
bhaddow
a2730c445d Merge up to 3791 from trunk. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/mira-mtm5@3792 1f5c12ca-751b-0410-a591-d2e778427230
 2011-01-05 13:49:44 +00:00
bhaddow
80efb4f8da Merge up to 3791 from trunk. 
git-svn-id: http://svn.statmt.org/repository/mira@3792 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2011-01-05 13:49:44 +00:00
chardmeier
4d315fee88 Added parameter declaration. 
Removed excessive debugging output.


git-svn-id: http://svn.statmt.org/repository/mira@3791 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2010-12-21 15:04:58 +00:00
dowobeha
1a9566089e Included qsub array functionality in moses-parallel.pl 
git-svn-id: http://svn.statmt.org/repository/mira@3790 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2010-12-17 18:24:18 +00:00
dowobeha
892e3086be Merged latest trunk changes into lane-syntax 
git-svn-id: http://svn.statmt.org/repository/mira@3789 cc96ff50-19ce-11e0-b349-13d7f0bd23df
 2010-12-17 16:57:37 +00:00