Commit Graph

1801 Commits

Author SHA1 Message Date
phkoehn
447dccfc59 more analysis in experiment.perl
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3234 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 11:28:55 +00:00
leven101
57b1297321 git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3233 1f5c12ca-751b-0410-a591-d2e778427230 2010-05-07 10:24:24 +00:00
leven101
e1ea1e8301 added suffix array phrase table updater service to moses server
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3232 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 09:50:19 +00:00
hieuhoang1972
034528988d better -T output for chart decoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3231 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 19:46:23 +00:00
hieuhoang1972
d4a6397ac4 hold chart rule in hypos instead of target phrase
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3230 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 18:09:03 +00:00
hieuhoang1972
44e2247086 minor
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3229 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:35:25 +00:00
hieuhoang1972
b6a92ba8af delete param object after decoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3228 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:26:52 +00:00
hieuhoang1972
a6b7807b2e less debugging info from OnDisk pt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3227 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:19:53 +00:00
bhaddow
ffea53717e Refactoring of output search graph code to enable it to be used
from moses server.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:53:41 +00:00
phkoehn
45ecfa72d2 minor changes to experiment.perl
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3225 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:06:34 +00:00
phkoehn
2ed6804f12 official release of experiment.perl
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3224 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-04 23:04:10 +00:00
bojar
0118733a45 fixing traditional distortion penalty with -continue-partial-translation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3222 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:41:28 +00:00
bojar
0a21c35fef fixed to initialize m_currSourceWordsRange correctly with -continue-partial-translation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3221 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:41:00 +00:00
bojar
b7a48d3962 adding a simple regression test for continue-partial-translation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3220 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:40:43 +00:00
bojar
65eb118d62 fixed Ondrej Odchazel's code to include partial output in LM scoring, renamed to match style
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3219 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:40:17 +00:00
bojar
c9ba824c70 applying Ondrej Odchazel's patch
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3218 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:39:43 +00:00
bojar
30921793a4 Ondrej Odchazel's update for AJAX-CAT
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3217 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:39:23 +00:00
bojar
4cc43c61f2 without parallelizer, -nbest-list must not be quoted
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3214 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-29 20:25:36 +00:00
hieuhoang1972
43ee86e92b make debug output same as phrase-based
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3210 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:57:56 +00:00
hieuhoang1972
e9cd6d0fde regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3209 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:41:53 +00:00
hieuhoang1972
b73293f3a8 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3208 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:39:05 +00:00
hieuhoang1972
a8f75cb789 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3207 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 17:48:15 +00:00
hieuhoang1972
87c3becbf6 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3206 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:21:19 +00:00
hieuhoang1972
d5a0eb2423 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3205 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:16:44 +00:00
hieuhoang1972
430446f404 regression
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3204 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:03:35 +00:00
hieuhoang1972
2bf009008b move sentence-based cache cleaning into IRST LM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3203 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 14:56:06 +00:00
nicolabertoldi
1c615ea751 re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 13:38:56 +00:00
hieuhoang1972
1a638746f3 SRI compile error in Ondrej's parallel backoff LM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3201 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 12:02:28 +00:00
nicolabertoldi
cf468273bc Safer way to cleanup LM caches after a given number of processed sentences.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available).
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-23 15:01:06 +00:00
chardmeier
ca353d3e68 - word lattice distortion calculation and distortion limit checks revisited
- crash in a controlled way if a jump in a word lattice exceeds max-phrase-length
- check if a sufficient number of ttable-limits is specified in the configuration

Thanks to Arianna Bisazza for help with sorting out lattice distortion and
to Suzy Howlett for help with debugging the other issues.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3193 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-22 08:42:32 +00:00
bojar
21de1e121f Merge branch 'master' into moses-svn
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3192 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-21 14:48:32 +00:00
hieuhoang1972
44368da77d xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3153 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-21 11:27:45 +00:00
bojar
db8e3357f5 Merge branch 'zmert' into moses-svn
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3152 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 22:03:04 +00:00
bojar
aa6043a556 mert-moses must quote -n-best-list *if* passed through parallelizer (and must not otherwise)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3151 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 17:02:58 +00:00
bojar
8ea058bfc7 fixed handling of the lmodel section; has only 3 ints
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3150 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 17:02:41 +00:00
bojar
403bc99cfb Merge branch 'moses-svn' into temp3
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3148 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 15:27:42 +00:00
bojar
34a0e9b3a2 support for SRILM's factored language models, implemented by Michal Richter
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3147 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 15:25:52 +00:00
bojar
323d48a821 factored version of PhraseDictionaryDynSuffixArray; squashed cmt of following:
commit b8a86018e1100efede28023c1b351a4e27da9b75
Author: Kamil Kos <kamil.kos@matfyz.cz>
Date:   Tue Apr 20 14:28:40 2010 +0200

    added comments and  minor bug fixes

    Conflicts:

    	moses/src/BilingualDynSuffixArray.cpp
    	moses/src/PhraseDictionary.cpp
    	moses/src/PhraseDictionaryDynSuffixArray.h

commit 7d09ec19bb49f516a98bf6e6e2cd86c19d428e73
Author: Kamil Kos <kamil.kos@matfyz.cz>
Date:   Thu Apr 15 18:29:08 2010 +0200

    factored version of PhraseDictionaryDynSuffixArray


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3146 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 14:09:53 +00:00
bojar
a7677e7fa2 releasing zmert-moses as well
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3145 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 11:11:49 +00:00
bojar
f36f347014 safer everything: tempdir, open, execution
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3144 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 11:10:31 +00:00
bojar
0dd5149925 allow changing FLAVOR using env. var.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3143 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 11:06:51 +00:00
hieuhoang1972
0e01ebaadb lex reordering bug
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3142 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 17:26:54 +00:00
bhaddow
ee1f6c9db9 Add serial mode to the server
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3141 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 17:04:25 +00:00
rafpayen
baa0a9df1c Check srilm's library (machine-type is not reliable enough)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3139 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 14:02:48 +00:00
bhaddow
b35ab24bb8 Fix mosesmt phrase table loading (it got squashed in the chart merge)
Fix some of the unused warnings.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3138 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 13:52:56 +00:00
pjwilliams
2edfc16912 Merge remaining script support for tree-based models from mt3_chart.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3137 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-16 09:45:51 +00:00
hieuhoang1972
a2233d0f8d xcode
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3136 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-14 16:53:39 +00:00
pjwilliams
264c9150d1 Use external consolidate' program in train-factored-phrase-model.perl.'
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3135 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-14 15:51:20 +00:00
pjwilliams
5faaedc0df Copy in consolidate,' consolidate-direct,' and the new version of
`score' from mt3_chart.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3134 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-14 15:50:17 +00:00