Commit Graph

1821 Commits

Author SHA1 Message Date
bhaddow
bb2431331c Fix to consensus decoding to stop it discarding hypos with zero score.
Move hypothesis id management into Manager to make it thread-safe.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3257 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-14 09:33:03 +00:00
leven101
ff6d734b60 small fix for regex use
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3256 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-13 16:05:10 +00:00
leven101
f0e8f86501 fixed double free bug
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3255 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-13 16:03:56 +00:00
chardmeier
6f8d9fa0fb Added limited backwards compatibility with old ini file format for phrase table specs.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3253 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-13 14:12:05 +00:00
hieuhoang1972
f028e1d9bd add space @ end of line after each trans
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3251 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 23:07:15 +00:00
hieuhoang1972
f36759478b don't spew out param list if there's a genuine error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3250 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 21:44:35 +00:00
hieuhoang1972
ecee5c5089 m_detailedTranslationReportingStream=NULL if not outputting trans opt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3249 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 20:56:31 +00:00
bhaddow
0b6346a310 Add consensus decoding to mosesmt. Really need to get the mainlines merged!
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3248 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-11 14:55:59 +00:00
phkoehn
c15fc6f104 minor bug fixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3247 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-10 22:41:54 +00:00
phkoehn
f52a2cc55d code cleanup & enable trace ("-t") for MBR decoding ("-mbr")
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3246 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-10 21:18:47 +00:00
phkoehn
524b1b12d2 added info for input phrase coverage
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3245 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-10 03:05:35 +00:00
phkoehn
883d12d482 added info for input word coverage to analysis + fixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3244 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-10 00:19:40 +00:00
pjwilliams
2a5b262503 Write translation details to a named file instead of cerr.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3243 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-08 15:51:59 +00:00
bojar
dcb8aafca7 rename train-factored-....perl to train-model.perl also in the Makefile and releasing
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3242 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 23:17:55 +00:00
leven101
ed0a9a369b git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3241 1f5c12ca-751b-0410-a591-d2e778427230 2010-05-07 21:25:53 +00:00
hieuhoang1972
e67670ad5b add alignment info for -T output
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3240 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 19:33:39 +00:00
pjwilliams
fd4851f15d Merge moses_chart's two IOWrapper constructors into one.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3238 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 18:43:34 +00:00
pjwilliams
01f4ca892a Remove the lmstats parameter since it doesn't have any effect except as
a synonym for translation-details.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3237 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 17:38:20 +00:00
leven101
f4696695f8 git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3236 1f5c12ca-751b-0410-a591-d2e778427230 2010-05-07 16:55:48 +00:00
leven101
ad554c7d6d git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3235 1f5c12ca-751b-0410-a591-d2e778427230 2010-05-07 16:54:25 +00:00
phkoehn
447dccfc59 more analysis in experiment.perl
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3234 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 11:28:55 +00:00
leven101
57b1297321 git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3233 1f5c12ca-751b-0410-a591-d2e778427230 2010-05-07 10:24:24 +00:00
leven101
e1ea1e8301 added suffix array phrase table updater service to moses server
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3232 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 09:50:19 +00:00
hieuhoang1972
034528988d better -T output for chart decoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3231 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 19:46:23 +00:00
hieuhoang1972
d4a6397ac4 hold chart rule in hypos instead of target phrase
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3230 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 18:09:03 +00:00
hieuhoang1972
44e2247086 minor
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3229 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:35:25 +00:00
hieuhoang1972
b6a92ba8af delete param object after decoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3228 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:26:52 +00:00
hieuhoang1972
a6b7807b2e less debugging info from OnDisk pt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3227 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:19:53 +00:00
bhaddow
ffea53717e Refactoring of output search graph code to enable it to be used
from moses server.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:53:41 +00:00
phkoehn
45ecfa72d2 minor changes to experiment.perl
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3225 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:06:34 +00:00
phkoehn
2ed6804f12 official release of experiment.perl
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3224 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-04 23:04:10 +00:00
bojar
0118733a45 fixing traditional distortion penalty with -continue-partial-translation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3222 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:41:28 +00:00
bojar
0a21c35fef fixed to initialize m_currSourceWordsRange correctly with -continue-partial-translation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3221 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:41:00 +00:00
bojar
b7a48d3962 adding a simple regression test for continue-partial-translation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3220 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:40:43 +00:00
bojar
65eb118d62 fixed Ondrej Odchazel's code to include partial output in LM scoring, renamed to match style
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3219 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:40:17 +00:00
bojar
c9ba824c70 applying Ondrej Odchazel's patch
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3218 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:39:43 +00:00
bojar
30921793a4 Ondrej Odchazel's update for AJAX-CAT
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3217 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:39:23 +00:00
bojar
4cc43c61f2 without parallelizer, -nbest-list must not be quoted
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3214 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-29 20:25:36 +00:00
hieuhoang1972
43ee86e92b make debug output same as phrase-based
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3210 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:57:56 +00:00
hieuhoang1972
e9cd6d0fde regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3209 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:41:53 +00:00
hieuhoang1972
b73293f3a8 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3208 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:39:05 +00:00
hieuhoang1972
a8f75cb789 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3207 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 17:48:15 +00:00
hieuhoang1972
87c3becbf6 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3206 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:21:19 +00:00
hieuhoang1972
d5a0eb2423 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3205 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:16:44 +00:00
hieuhoang1972
430446f404 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3204 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:03:35 +00:00
hieuhoang1972
2bf009008b move sentence-based cache cleaning into IRST LM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3203 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 14:56:06 +00:00
nicolabertoldi
1c615ea751 re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 13:38:56 +00:00
hieuhoang1972
1a638746f3 SRI compile error in Ondrej's parallel backoff LM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3201 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 12:02:28 +00:00
nicolabertoldi
cf468273bc Safer way to cleanup LM caches after a given number of processed sentences.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available).
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-23 15:01:06 +00:00