moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2025-01-08 12:36:35 +03:00
Code Issues Packages Projects Releases Wiki Activity
1,688 Commits 136 Branches 26 Tags 147 MiB
202bcf2911
Commit Graph

879 Commits

Author SHA1 Message Date
hieuhoang1972
202bcf2911 eclipse build 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3015 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-31 20:03:54 +00:00
bhaddow
742355266d Fix leak which was affecting mbr/lmbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3013 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-31 13:16:39 +00:00
hieuhoang1972
853c443375 delete old lex reordering code 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3010 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-30 22:48:26 +00:00
hieuhoang1972
4bb021d0ce ide project files 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3008 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-30 10:51:12 +00:00
bhaddow
5f734d3b9f Merged r2670-3001 from hierarchical-reo branch 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3002 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-25 11:43:18 +00:00
bhaddow
795224736b Merge revisions 2670-2988 from track. Passes all regression except lexicalised 
reordering


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2989 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-19 17:52:51 +00:00
bhaddow
ee2ae991e5 Roll-back to non-reproducible, but transitive Compare operation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2988 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-19 16:59:08 +00:00
bhaddow
22b74b56f7 Output of nbest from lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2980 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-16 11:34:50 +00:00
bhaddow
0208bddb70 Added parameters for lmbr n-best 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2971 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-14 20:23:17 +00:00
abarun
154b01a2ef More efficient implementation of print all derivations 2 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2958 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-08 16:30:31 +00:00
abarun
e09be2bfd5 More efficient implementation of print all derivations 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2957 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-08 15:28:40 +00:00
abarun
86ef292af1 Writing out sentence number when printing all derivations 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2954 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 08:28:16 +00:00
abarun
3434d15cda Lattice MBR pruning based on target length of MAP hypothesis 
Added option (-disable-discarding) to disable discarding of hypos during search
Added option (-print-all-derivations) to output (in unsorted order) ALL derivations found in search graph 


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2953 1f5c12ca-751b-0410-a591-d2e778427230
 2010-03-07 07:57:48 +00:00
jfouet
242846f07c Use portable include guard instead of pragma once 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2939 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 11:15:44 +00:00
jfouet
e14dc33dc8 enable trace with a configure options and fix compilation error when trace are disabled 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2938 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:37:49 +00:00
jfouet
087b2021c5 Link libmoses with boost-thread 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2936 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:34:00 +00:00
jfouet
5403d34faf pragma only valid with visual studio 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2935 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:30:24 +00:00
jfouet
133f18bd90 Use stringstream operation instead of atoi and atof to prevent error and overflow 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2934 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:03:22 +00:00
jfouet
50c22f1e42 Fix seg fault when libmoses is used ad a dynamic library on windows, MagicWord was initialized to a wrong value 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2933 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 10:02:17 +00:00
jfouet
7c1e287c71 Add configure options to link dynamically with libmoses 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2932 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-24 09:27:18 +00:00
bhaddow
0ade2ac432 Fix lattice mbr grid search so that the full lattice is created and pruned correctly. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2929 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-22 23:42:35 +00:00
chardmeier
ac942f8358 Removed requirement that the number of probabilities cached in a 
translation model for a given model be equal to the number of
feature functions provided by the model so collapseff lexical
reordering models work.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2921 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-20 09:55:02 +00:00
bhaddow
b2201e765d Grid search for lattice mbr 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2913 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 14:15:34 +00:00
bojar
cce14523ab added -report-all-factors-in-n-best 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2909 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-18 10:54:33 +00:00
bhaddow
7ebfb57818 Preallocate vector to speedup copy 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2908 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-17 19:05:34 +00:00
leven101
b63de914a5 added ability to go src->trg and trg->src phrase extraction in suffix array phrase implementation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2895 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 17:29:15 +00:00
sarst
c65945b531 Cleaned up lescial reordering scoring, and sent vectors as references instead of copying them. Fixed bugs in extract: it used to choose the wrong orientation at end of sentences, and the hierarchical model typ is no longer dependent on the phrase-based model type. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2892 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 13:46:33 +00:00
chardmeier
1b1f786373 Added missing namespace reference. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2891 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 12:22:17 +00:00
leven101
118a11497a Added suffix array phrase dictionary 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2890 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-12 11:05:43 +00:00
chardmeier
7117fef52a Fixed dependency on previous scores for lexical reordering states. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2889 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-11 17:08:24 +00:00
sarst
92368ba490 Rewrote the lexical reordering model scoring in C++. Adapted train-factored-phrase-model.perl to that change. Minor fixes in other places, for compatibility 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2884 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-10 17:19:06 +00:00
abarun
20216dbfec Nbest MBR fix 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2879 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-09 11:37:33 +00:00
abarun
27c3b6c182 Disabled weight-file option - broken 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2873 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-08 17:34:14 +00:00
abarun
4ac95fb82a Can now set thetas for Lattice MBR in terms of p and r (see Tromble et al. 08) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2855 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 19:46:35 +00:00
abarun
b4b7a71c46 Set appropriate verbose level for Lattice MBR 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2854 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 17:30:07 +00:00
chardmeier
9adc3ee500 FFState ordering uses hypothesis ids now. 
Changed order of scores to match latest trunk (exponential distortion next to lexical reordering).


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2844 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 13:10:31 +00:00
abarun
117f5ef329 Lattice MBR now uses nbest list as default hypothesis set during reranking. 
To use lattice instead as hypothesis set, run with -lattice-hypo-set option


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2843 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 11:20:20 +00:00
abarun
32a58a3ec9 Implemented Lattice MBR for Moses. 
Call using -lmbr option.
Specify thetas using -lmbr-thetas and lattice pruning factor (edge density) using -lmbr-pruning-factor
Currently only supports nbest-list as hypothesis set (specify using -nbest-hypo-set)


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2841 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-03 10:23:32 +00:00
bhaddow
aa961a1c15 Fix compile error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2824 1f5c12ca-751b-0410-a591-d2e778427230
 2010-02-01 11:51:49 +00:00
chardmeier
be66463f5a Changed 'word' reordering type to 'wbe'. Added explanatory comments. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2800 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 23:58:07 +00:00
chardmeier
177277b7de Fixed score order in MSLR model. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2799 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 23:46:34 +00:00
chardmeier
1e076d51e7 Cleaned up forward reordering model. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2798 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 23:08:33 +00:00
chardmeier
2375365cf6 Fixed forward model. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2797 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 22:47:36 +00:00
bojar
9e7c97ddbc fixed a minor bug introduced by previous commit 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2781 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 17:11:34 +00:00
bojar
c12c8d85dd a bit more verbose about when and how to use -constraint 
Conflicts:


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2780 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 17:11:17 +00:00
sarst
766a0f95c0 allowing word in configuration of lexical reordering 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2761 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 11:37:12 +00:00
chardmeier
c73d90c911 Removed debugging instrumentation. 
Changed score producer name to look more like the others.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2760 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 11:33:28 +00:00
chardmeier
c8674d45c0 Added comparison to self in FFStateArray::Compare. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2756 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-29 11:05:41 +00:00
chardmeier
1d879ac349 Reenabled FFStateArray comparison. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2738 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 19:27:49 +00:00
chardmeier
8e43a5dca0 Fixed FFStateArray comparison. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/hierarchical-reo@2734 1f5c12ca-751b-0410-a591-d2e778427230
 2010-01-28 18:56:53 +00:00