Commit Graph

8325 Commits

Author SHA1 Message Date
Colin Cherry
3c44d04baf Merge branch 'master' into miramerge
Conflicts:
	Jamroot
	mert/FeatureStats.cpp
	moses-cmd/src/IOWrapper.h
	scripts/training/mert-moses.pl
	scripts/training/train-model.perl.missing_bin_dir
2012-05-30 12:39:53 -04:00
Tetsuo Kiso
beb2256dba Move 'using namespace std' out from .h.
Add "std" to size_t, too.
2012-05-30 23:11:09 +09:00
Tetsuo Kiso
01eb60f350 Add "virtual" destructor to the HypPackEnumerator class. 2012-05-30 22:59:23 +09:00
Hieu Hoang
d25805858d xcode build supports threads. move 'using namespace' out from .h file to stop namespace pollution 2012-05-30 13:04:02 +01:00
Hieu Hoang
45870348ff xcode build supports threads. move 'using namespace' out from .h file to stop namespace pollution 2012-05-30 12:47:20 +01:00
Hieu Hoang
9f03125418 Minor rollback 2012-05-30 11:50:01 +01:00
Hieu Hoang
21cd9e6286 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-30 09:53:02 +01:00
Hieu Hoang
2b20de8ea9 xcode build supports threads. Abort when using Adam's suffix arrays with threads 2012-05-30 09:49:43 +01:00
phikoehn
2e370ed11b more escaping in tokenizer; wrapper for berkeley parser (german) 2012-05-30 00:58:18 +01:00
Hieu Hoang
c85b96a6c6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-29 19:14:49 +01:00
Colin Cherry
fd577d7a65 Batch k-best MIRA is written and integrated into mert-moses.pl
Regression tests all check out, and kbmira seems to work fine
on a Hansard French->English task.

HypPackEnumerator class may be of interest to pro.cpp and future
optimizers, as it abstracts a lot of the boilerplate involved in
enumerating multiple k-best lists.

MiraWeightVector is not really mira-specific - just a weight vector
that enables efficient averaging. Could be useful to a perceptron
as well. Same goes for MiraFeatureVector.

Interaction with sparse features is written, but untested.
2012-05-29 13:38:57 -04:00
Hieu Hoang
ac764f9dce Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-29 15:29:33 +01:00
phikoehn
6d1165654c script updates and added ems config help 2012-05-28 20:15:58 +01:00
Hieu Hoang
ef26388aff eclipse project 2012-05-28 17:29:46 +01:00
Phil Williams
db1e6040b2 Fix bug in previous commit. 2012-05-27 17:58:13 +01:00
Phil Williams
e3e62846bf train-model.perl: add -alt-direct-rule-score-1 and
-alt-direct-rule-score-2 options, which use either
p(RHS_t|RHS_s,LHS) or p(LHS,RHS_t|RHS_s), respectively,
as a grammar rule's direct translation score.
2012-05-27 12:43:16 +01:00
Phil Williams
82580280bc Fix compile error by using std::size_t instead of size_t.
Thanks to Tomas Hudik for reporting that.
2012-05-26 13:13:23 +01:00
Hieu Hoang
7b0d04f341 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-26 12:29:45 +01:00
Hieu Hoang
cae4f803c3 faster consolidating - redirect to stdout then zip 2012-05-26 12:27:50 +01:00
Hieu Hoang
4c90c88733 make phrase-table.half naming consistent. Requested by Phil Williams 2012-05-26 12:21:32 +01:00
Phil Williams
145df588c2 Fix some input handling bugs in pcfg-extract and pcfg-score. 2012-05-26 12:15:34 +01:00
phikoehn
07fafd51b5 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-05-26 00:10:08 +01:00
phikoehn
561b9ac956 minor fixes 2012-05-26 00:09:50 +01:00
phikoehn
180dd773f6 bolt specific settings 2012-05-26 00:06:34 +01:00
Phil Williams
a72744c49b Fix bug in previous commit. 2012-05-25 17:39:21 +01:00
Phil Williams
90c0bc9f5c Add an optional PCFG scoring feature for target syntax models (similar to
the p_cfg feature used in Marcu, Wang, Echihabi, and Knight (2006)).
2012-05-25 17:29:47 +01:00
Phil Williams
2fab137aae Fix compile error. 2012-05-25 17:24:08 +01:00
Hieu Hoang
b8cf0deb65 Merge github.com:moses-smt/mosesdecoder 2012-05-25 17:13:47 +01:00
Hieu Hoang
721ce923cc add -snt2cooc to train-model.perl. For giza's reduced memory snt2cooc.perl 2012-05-25 15:06:35 +01:00
Hieu Hoang
7d602aff2f Move queryOnDiskPt from contrib to OnDiskPt folder. Easier to amend Jam file 2012-05-25 13:41:54 +01:00
Hieu Hoang
8844be6f25 Move queryOnDiskPt from contrib to OnDiskPt folder. Easier to amend Jam file 2012-05-25 13:41:06 +01:00
Hieu Hoang
911133c38d Merge branch 'master' of github.com:hieuhoang/mosesdecoder 2012-05-25 12:44:21 +01:00
Hieu Hoang
fcf817fda2 add --parallel to sorting options 2012-05-25 12:42:11 +01:00
Barry Haddow
d4a2414bf0 Merge branch 'trunk' into miramerge 2012-05-25 09:59:11 +01:00
Hieu Hoang
480b2f2fcd Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-24 23:29:14 +01:00
Hieu Hoang
49d9d54ba4 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-24 23:18:39 +01:00
Hieu Hoang
02ede29fa0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-24 23:18:39 +01:00
Hieu Hoang
e3fc412c49 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-24 22:33:10 +01:00
Hieu Hoang
aa5f849e3e Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-24 22:33:10 +01:00
Hieu Hoang
8f82d21eb8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-24 22:33:10 +01:00
Hieu Hoang
fcb2955a88 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-05-24 22:33:10 +01:00
Barry Haddow
673059fc48 Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
9f5320c069 Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
850ff04a9d Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
71f7dde16c Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:32:30 +01:00
Barry Haddow
c8207e237c Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
e698d16fcd Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
8e8b7f00cb Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
1de45510e2 Fix globs so that it runs all tests
(except for extract tests and apparently broken chart kenlm test)
2012-05-24 22:11:47 +01:00
Barry Haddow
30900141e7 Fix compile errors 2012-05-24 21:34:06 +01:00