moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-29 06:52:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
927 Commits 136 Branches 26 Tags 147 MiB
e1823a52ac
Commit Graph

927 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
hieuhoang1972
e1823a52ac prune arcList & LatticePathCollection (contenders for n-best paths) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1134 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-22 12:30:06 +00:00
hieuhoang1972
ff538c2e2f fixed mem leak 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1131 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-21 13:38:03 +00:00
hieuhoang1972
b21188e26f visual studio projects 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1130 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-20 22:03:48 +00:00
redpony
83f8b58814 add notes about building scripts/ separately 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1128 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-18 19:12:43 +00:00
bojar
20526df3a7 minor typos in my part 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1125 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-11 01:12:44 +00:00
redpony
a97d347479 add documentation about using - as the n-best-list filename 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1117 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-08 15:07:17 +00:00
redpony
0f3ee4b814 If - is specified as the name of the n-best list file, write to std::cout and surpress the normal best hypothesis output. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1116 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-08 14:46:48 +00:00
mfederico
f09bde38c6 quantize-lm: improved messages and check, improved memory usage, added optional temporary file. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1115 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-08 09:05:39 +00:00
hieuhoang1972
970af347e4 Bug fixed for distortion model proposed by Tim Murray 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1111 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-07 12:36:18 +00:00
mfederico
8700f33c98 a much more efficient version of quantize-lm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1109 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-03 23:25:53 +00:00
nicolabertoldi
29705a2c81 reset caches to their initial values 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1106 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-02 18:17:01 +00:00
hieuhoang1972
0aba61ca8b don't insist on using python 2.3 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1104 1f5c12ca-751b-0410-a591-d2e778427230
 2007-01-02 12:54:00 +00:00
lexi_birch
93937b529d Making remaining scripts os independent re pawd/pwd 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1103 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-29 13:45:21 +00:00
nicolabertoldi
239e57c16c managing of pwd/pawd 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1102 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-29 13:19:36 +00:00
nicolabertoldi
26aff6ead9 managing of pwd/pawd 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1101 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-29 13:19:21 +00:00
nicolabertoldi
51d74a3941 remove obsolete code 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1100 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-29 12:13:23 +00:00
nicolabertoldi
92eadd7c0c - change from pawd to pwd, because pawd is not available on some Linux distribution 
- moses-parallel.pl: new way of passing parameters to decoder with parameter  -decoder-parameters
- moses-parallel.pl: possibility of saving decoder logs (parameter -logfile)



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1099 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-29 10:48:41 +00:00
hieuhoang1972
ddd2fdeb20 Fix automount partition bug 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1098 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-29 00:59:59 +00:00
hieuhoang1972
566491237a Fix automount partition bug 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1097 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-29 00:51:11 +00:00
lexi_birch
dee506806f Fix for mount bug using pwd on terabyte 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1096 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-28 22:17:06 +00:00
hieuhoang1972
e701f57f07 halcion days of the jhu workshop are over and grim reality has taken hold. 
default qsub not to use workshop specific queue

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1079 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-16 22:33:55 +00:00
bojar
c1370484a2 - Fixed bug with brevity penalty: 
If two reference translations of a sentence were equally "close" to the
    hypothesis, the *first* one was taken into account, given the order of
    references.
    Now the *shorter* is used, making brevity independent on the order of
    references. (Papineni etal are not specific about this, either).
    (Consider the case where the hypothesis is 30 words and there are two
    references, one of 28 and one of 32 words.)
- Fixed usage-behaviour inconsistency:
    usage said that ref.0, ref.1, .. are loaded but it loaded only
      ref.1, ref.2,...


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1071 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-15 05:31:47 +00:00
hieuhoang1972
176e408327 floor trans scores 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1061 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-13 12:45:59 +00:00
hieuhoang1972
afe5f3bf2e undo update to regression data version 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1060 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-13 12:41:15 +00:00
redpony
7a4043a3c9 allow both IRST and SRI, part 2 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1035 1f5c12ca-751b-0410-a591-d2e778427230
 2006-12-02 03:10:16 +00:00
mfederico
5621a5df89 Fixed IRST LM bug. Basically, changed return value 
of LanguageModelIRST::Load from FALSE to TRUE,
similarly to what LanguageModelSRI::Load does.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1027 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-30 13:47:22 +00:00
bojar
72ff1f8450 added yet another combiner for factored corpora 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1026 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-30 06:17:45 +00:00
bojar
412f04737c allows reducing factors from stdin 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1025 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-30 03:46:21 +00:00
hieuhoang1972
abd4adfb0c undo accidental checkin for MosesRegressionTesting.pm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@999 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-22 15:50:59 +00:00
phkoehn
0a088dbb38 fixed error in filtering for lexicalized reordering tables 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@998 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-22 15:50:20 +00:00
hieuhoang1972
dd721e1b4f Mac xcode proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@997 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-22 15:19:28 +00:00
hieuhoang1972
7af5bb462e dismantle IODevoce framework 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@992 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 23:06:30 +00:00
hieuhoang1972
7e00b6ee8b fixed merge error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@991 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 22:54:35 +00:00
hieuhoang1972
c49a2e31bf eclipse preferences. not sure if need to go into svn 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@990 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:59:20 +00:00
hieuhoang1972
24a5687bed minor gcc compile errors 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@989 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:53:03 +00:00
hieuhoang1972
a1f39c3ce7 lots of small changes and code clean up: 
error catching/fail more gracefully on tables/lm load error & consistent user output
consistent debugging output
cleaned up timing functions
cleaned up mose/moses-cmd api calls/interaction
split up loading of all data in StaticData into separate fns
got binary phrase table to work under WIN32 & passed regression !!
added more comments
deleted phrase table filtering code
deleted mysql support
change calls to ToString() which might affect decoding to a call to a non-debugging fn instead, eg GetString()


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@988 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 19:35:37 +00:00
ccorbett
880e548810 added first draft of lexical reordering section, need to rewrite by going over with Brooke and Wade in the next couple days 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@987 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-21 04:40:13 +00:00
nicolabertoldi
90d9147d9e Add simple regression test for nbest 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@986 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-20 13:42:04 +00:00
nicolabertoldi
7f7e7dfbd9 Add regression test for confusion network and multiple factors 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@985 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-20 13:27:24 +00:00
mfederico
cdff620f58 LanguageModelIRST: memory mapping is now applied only to LM files ending with suffix ".mm" . 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@984 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-20 08:19:56 +00:00
hieuhoang1972
d2a56a1ca1 comments/better example in Makefile 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@983 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 20:01:23 +00:00
hieuhoang1972
60a958d8ee eclipse proj 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@982 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 18:28:47 +00:00
nicolabertoldi
f430460b7d Clean up. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@981 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 10:53:32 +00:00
nicolabertoldi
5272e4d241 Modified output of feature scores. 
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@980 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 10:43:57 +00:00
nicolabertoldi
8e06834ec1 Modified output of feature scores. 
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@979 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-16 10:43:40 +00:00
phkoehn
28ca9b57fd minor bug fixes for training and using lexicalized reordering 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@978 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-15 17:04:19 +00:00
hieuhoang1972
9ea1e276d3 eclipse proj file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@977 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-15 13:14:04 +00:00
hieuhoang1972
297280cb48 updated eclispe project file to work with calipso version 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@976 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 23:06:45 +00:00
hieuhoang1972
e9b38c2949 statically zlib on WIN32 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@975 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-14 21:34:24 +00:00
redpony
5f8dde7a1a fix nbest list behavior to generate n best translations, not n+1. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@974 1f5c12ca-751b-0410-a591-d2e778427230
 2006-11-13 15:23:21 +00:00