Commit Graph

9455 Commits

Author SHA1 Message Date
Tetsuo Kiso
cd3fb3b831 Untabify. 2012-12-06 23:46:22 +09:00
Tetsuo Kiso
ac045a11c1 Speed up N-gram counts when running extractor.
By replacing std::map with boost::unordered_map.

Runtime of extractor on 100-best lists of 2679 sentences:

Before:
real    0m35.314s
user    0m34.030s
sys     0m1.280s

Ater:
real    0m26.729s
user    0m25.420s
sys     0m1.310s
2012-12-06 22:08:33 +09:00
Hieu Hoang
55f65c3104 race condition in chart decoding with -T arg 2012-12-03 14:57:33 +00:00
phikoehn
ab2effb6fe train MML in-/out-of-domain language models with same vocabulary 2012-12-01 13:46:59 +00:00
phikoehn
269883fedd Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-12-01 13:45:00 +00:00
phikoehn
0c5d000192 my change to weight-wt 2012-12-01 13:44:57 +00:00
Marcin Junczys-Dowmunt
205cea8644 Allow .minlexr suffix and bugfix 2012-12-01 00:38:20 +01:00
Eva Hasler
650d31fe73 don't need to specify weight-wt 2012-11-30 18:04:50 +00:00
Hieu Hoang
a07f71d095 race condition on letter sed cache. Requires locking 2012-11-30 17:15:32 +00:00
Hieu Hoang
7abb3c878a remove locking. Make wordIndex variable local 2012-11-30 13:50:59 +00:00
Hieu Hoang
5fd9cbb529 delete reference to numpy. Doesn't need it 2012-11-30 10:28:51 +00:00
Hieu Hoang
017bbe78e8 forgotten misc programs for Compact pt 2012-11-30 09:49:36 +00:00
phikoehn
338b7656a6 ooops 2012-11-30 07:36:59 +00:00
phikoehn
84cb04c05a fixes and extensions to modified Moore-Lewis filtering, now works with domain features 2012-11-30 07:28:31 +00:00
phikoehn
1f7ee0e6c5 change of settings for sigtest filtering 2012-11-29 23:44:10 +00:00
Hieu Hoang
d4ead15066 fuzzy match phrase-table is multi-threaded 2012-11-29 15:27:38 +00:00
Hieu Hoang
9aad7c65c9 move CompactPt to TranslationModel/ 2012-11-27 18:04:01 +00:00
Hieu Hoang
152064086f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-11-27 17:33:42 +00:00
Hieu Hoang
b317ac1a34 compile error on misc programs 2012-11-27 17:33:04 +00:00
Hieu Hoang
bc1e96730d move CKY+Parser to TranslationModel/ 2012-11-27 17:23:31 +00:00
Hieu Hoang
ae8a48b022 move Score3Parser to TranslationModel/ 2012-11-27 17:09:23 +00:00
Hieu Hoang
1aae9aa23c move RuleTable to TranslationModel/ 2012-11-27 16:57:23 +00:00
Hieu Hoang
6bf2870f18 move the rest of DynSA to TranslationModel/ 2012-11-27 16:31:42 +00:00
Hieu Hoang
4d8e4ae6d8 move DynSAInclude to TranslationModel/ 2012-11-27 16:16:30 +00:00
Barry Haddow
f0e12912e7 mml-score.py. Support for combining with domain features. 2012-11-27 15:58:55 +00:00
Hieu Hoang
75108c0aaf minor debug messages 2012-11-27 15:39:08 +00:00
Hieu Hoang
0b54d32038 move fuzzy-match to TranslationModel/ 2012-11-27 15:36:24 +00:00
Hieu Hoang
59449f2925 make TranslationModel subdirectory and move files from moses/ into it 2012-11-27 15:08:31 +00:00
Hieu Hoang
a4cbaa51af multithreaded fuzzy match 2012-11-27 13:17:44 +00:00
Hieu Hoang
b30b2ffd03 compile error in fuzzy match 2012-11-27 12:29:36 +00:00
Hieu Hoang
9e08ef8c0d multithreaded fuzzy match 2012-11-27 10:42:28 +00:00
Hieu Hoang
ff1b210fe8 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-11-26 23:10:40 +00:00
Hieu Hoang
ea2ad978ef eclipse files 2012-11-26 23:10:23 +00:00
phikoehn
51afd322a1 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-11-24 20:13:30 +00:00
phikoehn
b5d08745a5 extensions to modified moore-lewis filtering, bug fixes 2012-11-24 20:13:14 +00:00
marcinj
bb76c156cf Added another consistency check for false positives 2012-11-24 17:58:07 +01:00
phikoehn
ea610a0558 added modified-moore-lewis from Barry Haddow into EMS 2012-11-24 12:43:13 +00:00
Hieu Hoang
7b36e11276 make fuzzy match pt threadable by marking it as non-threadable! TODO - do it properly 2012-11-23 18:52:06 +00:00
Hieu Hoang
cb95548871 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-11-23 17:38:57 +00:00
phikoehn
d4cebb008a added ems support for sigtest-filter 2012-11-23 17:35:13 +00:00
Hieu Hoang
65457aa1ac load source corpus along with suffix array. Use vocab from SA execlusively 2012-11-23 17:33:00 +00:00
Hieu Hoang
d0cf8f47db order of lexical probability has flipped 2012-11-22 17:37:36 +00:00
Hieu Hoang
487822ed14 don't write to stdout 2012-11-22 15:08:00 +00:00
Hieu Hoang
b2997025f0 add test misc perl file 2012-11-21 16:41:05 +00:00
phikoehn
c2a96fcc33 adjust to irstlm changes 2012-11-20 17:19:17 +00:00
phikoehn
5cd614ecd8 adjust to irstlm changes 2012-11-20 17:18:57 +00:00
Hieu Hoang
7d6d91a2e8 move zmert to contrib folder 2012-11-20 16:42:49 +00:00
Hieu Hoang
feff7affaf add tests for decoding with compressed pt 2012-11-20 16:14:20 +00:00
Hieu Hoang
dbf0123c5c don't load compact lex model if it doesn't exist 2012-11-20 13:22:03 +00:00
Hieu Hoang
0bf06666b1 add error message for non-existant input file 2012-11-20 12:11:01 +00:00