Colin Cherry
3c44d04baf
Merge branch 'master' into miramerge
...
Conflicts:
Jamroot
mert/FeatureStats.cpp
moses-cmd/src/IOWrapper.h
scripts/training/mert-moses.pl
scripts/training/train-model.perl.missing_bin_dir
2012-05-30 12:39:53 -04:00
Tetsuo Kiso
beb2256dba
Move 'using namespace std' out from .h.
...
Add "std" to size_t, too.
2012-05-30 23:11:09 +09:00
Tetsuo Kiso
01eb60f350
Add "virtual" destructor to the HypPackEnumerator class.
2012-05-30 22:59:23 +09:00
Hieu Hoang
d25805858d
xcode build supports threads. move 'using namespace' out from .h file to stop namespace pollution
2012-05-30 13:04:02 +01:00
Hieu Hoang
45870348ff
xcode build supports threads. move 'using namespace' out from .h file to stop namespace pollution
2012-05-30 12:47:20 +01:00
Hieu Hoang
9f03125418
Minor rollback
2012-05-30 11:50:01 +01:00
Hieu Hoang
21cd9e6286
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-30 09:53:02 +01:00
Hieu Hoang
2b20de8ea9
xcode build supports threads. Abort when using Adam's suffix arrays with threads
2012-05-30 09:49:43 +01:00
phikoehn
2e370ed11b
more escaping in tokenizer; wrapper for berkeley parser (german)
2012-05-30 00:58:18 +01:00
Hieu Hoang
c85b96a6c6
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-29 19:14:49 +01:00
Colin Cherry
fd577d7a65
Batch k-best MIRA is written and integrated into mert-moses.pl
...
Regression tests all check out, and kbmira seems to work fine
on a Hansard French->English task.
HypPackEnumerator class may be of interest to pro.cpp and future
optimizers, as it abstracts a lot of the boilerplate involved in
enumerating multiple k-best lists.
MiraWeightVector is not really mira-specific - just a weight vector
that enables efficient averaging. Could be useful to a perceptron
as well. Same goes for MiraFeatureVector.
Interaction with sparse features is written, but untested.
2012-05-29 13:38:57 -04:00
Hieu Hoang
ac764f9dce
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-29 15:29:33 +01:00
phikoehn
6d1165654c
script updates and added ems config help
2012-05-28 20:15:58 +01:00
Hieu Hoang
ef26388aff
eclipse project
2012-05-28 17:29:46 +01:00
Phil Williams
db1e6040b2
Fix bug in previous commit.
2012-05-27 17:58:13 +01:00
Phil Williams
e3e62846bf
train-model.perl: add -alt-direct-rule-score-1 and
...
-alt-direct-rule-score-2 options, which use either
p(RHS_t|RHS_s,LHS) or p(LHS,RHS_t|RHS_s), respectively,
as a grammar rule's direct translation score.
2012-05-27 12:43:16 +01:00
Phil Williams
82580280bc
Fix compile error by using std::size_t instead of size_t.
...
Thanks to Tomas Hudik for reporting that.
2012-05-26 13:13:23 +01:00
Hieu Hoang
7b0d04f341
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-26 12:29:45 +01:00
Hieu Hoang
cae4f803c3
faster consolidating - redirect to stdout then zip
2012-05-26 12:27:50 +01:00
Hieu Hoang
4c90c88733
make phrase-table.half naming consistent. Requested by Phil Williams
2012-05-26 12:21:32 +01:00
Phil Williams
145df588c2
Fix some input handling bugs in pcfg-extract and pcfg-score.
2012-05-26 12:15:34 +01:00
phikoehn
07fafd51b5
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2012-05-26 00:10:08 +01:00
phikoehn
561b9ac956
minor fixes
2012-05-26 00:09:50 +01:00
phikoehn
180dd773f6
bolt specific settings
2012-05-26 00:06:34 +01:00
Phil Williams
a72744c49b
Fix bug in previous commit.
2012-05-25 17:39:21 +01:00
Phil Williams
90c0bc9f5c
Add an optional PCFG scoring feature for target syntax models (similar to
...
the p_cfg feature used in Marcu, Wang, Echihabi, and Knight (2006)).
2012-05-25 17:29:47 +01:00
Phil Williams
2fab137aae
Fix compile error.
2012-05-25 17:24:08 +01:00
Hieu Hoang
b8cf0deb65
Merge github.com:moses-smt/mosesdecoder
2012-05-25 17:13:47 +01:00
Hieu Hoang
721ce923cc
add -snt2cooc to train-model.perl. For giza's reduced memory snt2cooc.perl
2012-05-25 15:06:35 +01:00
Hieu Hoang
7d602aff2f
Move queryOnDiskPt from contrib to OnDiskPt folder. Easier to amend Jam file
2012-05-25 13:41:54 +01:00
Hieu Hoang
8844be6f25
Move queryOnDiskPt from contrib to OnDiskPt folder. Easier to amend Jam file
2012-05-25 13:41:06 +01:00
Hieu Hoang
911133c38d
Merge branch 'master' of github.com:hieuhoang/mosesdecoder
2012-05-25 12:44:21 +01:00
Hieu Hoang
fcf817fda2
add --parallel to sorting options
2012-05-25 12:42:11 +01:00
Barry Haddow
d4a2414bf0
Merge branch 'trunk' into miramerge
2012-05-25 09:59:11 +01:00
Hieu Hoang
480b2f2fcd
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-24 23:29:14 +01:00
Hieu Hoang
49d9d54ba4
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-24 23:18:39 +01:00
Hieu Hoang
02ede29fa0
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-24 23:18:39 +01:00
Hieu Hoang
e3fc412c49
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-24 22:33:10 +01:00
Hieu Hoang
aa5f849e3e
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-24 22:33:10 +01:00
Hieu Hoang
8f82d21eb8
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-24 22:33:10 +01:00
Hieu Hoang
fcb2955a88
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-05-24 22:33:10 +01:00
Barry Haddow
673059fc48
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
9f5320c069
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
850ff04a9d
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
71f7dde16c
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
c8207e237c
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
e698d16fcd
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
8e8b7f00cb
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
1de45510e2
Fix globs so that it runs all tests
...
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
30900141e7
Fix compile errors
2012-05-24 21:34:06 +01:00