phkoehn
447dccfc59
more analysis in experiment.perl
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3234 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 11:28:55 +00:00
leven101
57b1297321
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3233 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 10:24:24 +00:00
leven101
e1ea1e8301
added suffix array phrase table updater service to moses server
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3232 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-07 09:50:19 +00:00
hieuhoang1972
034528988d
better -T output for chart decoding
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3231 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 19:46:23 +00:00
hieuhoang1972
d4a6397ac4
hold chart rule in hypos instead of target phrase
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3230 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 18:09:03 +00:00
hieuhoang1972
44e2247086
minor
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3229 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:35:25 +00:00
hieuhoang1972
b6a92ba8af
delete param object after decoding
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3228 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:26:52 +00:00
hieuhoang1972
a6b7807b2e
less debugging info from OnDisk pt
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3227 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-06 11:19:53 +00:00
bhaddow
ffea53717e
Refactoring of output search graph code to enable it to be used
...
from moses server.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3226 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:53:41 +00:00
phkoehn
45ecfa72d2
minor changes to experiment.perl
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3225 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-05 16:06:34 +00:00
phkoehn
2ed6804f12
official release of experiment.perl
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3224 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-04 23:04:10 +00:00
bojar
0118733a45
fixing traditional distortion penalty with -continue-partial-translation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3222 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:41:28 +00:00
bojar
0a21c35fef
fixed to initialize m_currSourceWordsRange correctly with -continue-partial-translation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3221 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:41:00 +00:00
bojar
b7a48d3962
adding a simple regression test for continue-partial-translation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3220 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:40:43 +00:00
bojar
65eb118d62
fixed Ondrej Odchazel's code to include partial output in LM scoring, renamed to match style
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3219 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:40:17 +00:00
bojar
c9ba824c70
applying Ondrej Odchazel's patch
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3218 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:39:43 +00:00
bojar
30921793a4
Ondrej Odchazel's update for AJAX-CAT
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3217 1f5c12ca-751b-0410-a591-d2e778427230
2010-05-03 21:39:23 +00:00
bojar
4cc43c61f2
without parallelizer, -nbest-list must not be quoted
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3214 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-29 20:25:36 +00:00
hieuhoang1972
43ee86e92b
make debug output same as phrase-based
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3210 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:57:56 +00:00
hieuhoang1972
e9cd6d0fde
regression
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3209 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:41:53 +00:00
hieuhoang1972
b73293f3a8
regression
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3208 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 18:39:05 +00:00
hieuhoang1972
a8f75cb789
regression
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3207 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 17:48:15 +00:00
hieuhoang1972
87c3becbf6
regression
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3206 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:21:19 +00:00
hieuhoang1972
d5a0eb2423
regression
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3205 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:16:44 +00:00
hieuhoang1972
430446f404
regression
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3204 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 16:03:35 +00:00
hieuhoang1972
2bf009008b
move sentence-based cache cleaning into IRST LM
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3203 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 14:56:06 +00:00
nicolabertoldi
1c615ea751
re-introduced the initialization and cleaning up into the constructor and destructor of Managers object. And I moved the check for LM cache cleanup into LanguageModelIRST
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3202 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 13:38:56 +00:00
hieuhoang1972
1a638746f3
SRI compile error in Ondrej's parallel backoff LM
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3201 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-26 12:02:28 +00:00
nicolabertoldi
cf468273bc
Safer way to cleanup LM caches after a given number of processed sentences.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3197 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-24 00:06:49 +00:00
nicolabertoldi
476528c05f
I added a new parameter (-clean-lm-cache <value>) in order to control how often the LMs clean up their caches (if available).
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3195 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-23 15:01:06 +00:00
chardmeier
ca353d3e68
- word lattice distortion calculation and distortion limit checks revisited
...
- crash in a controlled way if a jump in a word lattice exceeds max-phrase-length
- check if a sufficient number of ttable-limits is specified in the configuration
Thanks to Arianna Bisazza for help with sorting out lattice distortion and
to Suzy Howlett for help with debugging the other issues.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3193 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-22 08:42:32 +00:00
bojar
21de1e121f
Merge branch 'master' into moses-svn
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3192 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-21 14:48:32 +00:00
hieuhoang1972
44368da77d
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3153 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-21 11:27:45 +00:00
bojar
db8e3357f5
Merge branch 'zmert' into moses-svn
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3152 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 22:03:04 +00:00
bojar
aa6043a556
mert-moses must quote -n-best-list *if* passed through parallelizer (and must not otherwise)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3151 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 17:02:58 +00:00
bojar
8ea058bfc7
fixed handling of the lmodel section; has only 3 ints
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3150 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 17:02:41 +00:00
bojar
403bc99cfb
Merge branch 'moses-svn' into temp3
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3148 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 15:27:42 +00:00
bojar
34a0e9b3a2
support for SRILM's factored language models, implemented by Michal Richter
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3147 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 15:25:52 +00:00
bojar
323d48a821
factored version of PhraseDictionaryDynSuffixArray; squashed cmt of following:
...
commit b8a86018e1100efede28023c1b351a4e27da9b75
Author: Kamil Kos <kamil.kos@matfyz.cz>
Date: Tue Apr 20 14:28:40 2010 +0200
added comments and minor bug fixes
Conflicts:
moses/src/BilingualDynSuffixArray.cpp
moses/src/PhraseDictionary.cpp
moses/src/PhraseDictionaryDynSuffixArray.h
commit 7d09ec19bb49f516a98bf6e6e2cd86c19d428e73
Author: Kamil Kos <kamil.kos@matfyz.cz>
Date: Thu Apr 15 18:29:08 2010 +0200
factored version of PhraseDictionaryDynSuffixArray
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3146 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 14:09:53 +00:00
bojar
a7677e7fa2
releasing zmert-moses as well
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3145 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 11:11:49 +00:00
bojar
f36f347014
safer everything: tempdir, open, execution
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3144 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 11:10:31 +00:00
bojar
0dd5149925
allow changing FLAVOR using env. var.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3143 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-20 11:06:51 +00:00
hieuhoang1972
0e01ebaadb
lex reordering bug
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3142 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 17:26:54 +00:00
bhaddow
ee1f6c9db9
Add serial mode to the server
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3141 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 17:04:25 +00:00
rafpayen
baa0a9df1c
Check srilm's library (machine-type
is not reliable enough)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3139 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 14:02:48 +00:00
bhaddow
b35ab24bb8
Fix mosesmt phrase table loading (it got squashed in the chart merge)
...
Fix some of the unused warnings.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3138 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-19 13:52:56 +00:00
pjwilliams
2edfc16912
Merge remaining script support for tree-based models from mt3_chart.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3137 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-16 09:45:51 +00:00
hieuhoang1972
a2233d0f8d
xcode
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3136 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-14 16:53:39 +00:00
pjwilliams
264c9150d1
Use external consolidate' program in
train-factored-phrase-model.perl.'
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3135 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-14 15:51:20 +00:00
pjwilliams
5faaedc0df
Copy in consolidate,'
consolidate-direct,' and the new version of
...
`score' from mt3_chart.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3134 1f5c12ca-751b-0410-a591-d2e778427230
2010-04-14 15:50:17 +00:00