Commit Graph

9459 Commits

Author SHA1 Message Date
Hieu Hoang
27a6cf2ebc fuzzy match bug. Still not bug-free 2012-11-10 17:09:07 +00:00
Hieu Hoang
baf210f077 fizzy match bug 2012-11-10 14:57:27 +00:00
Hieu Hoang
6ea72d72f1 eclipse 2012-11-10 12:17:20 +00:00
Hieu Hoang
1bb7d038be Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-11-10 04:25:32 -05:00
Hieu Hoang
e75522b602 rename functions 2012-11-09 18:55:01 -05:00
Hieu Hoang
db29cc50d0 xcode 2012-11-09 18:13:20 -05:00
Barry Haddow
0d26c2f521 Sync showweights order with nbest 2012-11-09 12:11:49 +00:00
Hieu Hoang
88b2f05e03 process empty lines regardless 2012-11-09 01:26:21 -08:00
Hieu Hoang
32330c62a6 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-11-09 00:53:39 -08:00
Kenneth Heafield
e3e3ad4c0d cmph header makes it further than CompactPT 2012-11-09 08:44:09 +00:00
Hieu Hoang
f92eff62b2 eclipse files 2012-11-08 23:46:46 -08:00
Hieu Hoang
eae513d4ba Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-11-08 21:45:41 -07:00
Hieu Hoang
90b704562e eclipse files 2012-11-08 14:39:30 -07:00
Hieu Hoang
2e6346faa0 xcode and eclipse 2012-11-08 14:07:33 -07:00
Hieu Hoang
762a6b3219 xcode and eclipse 2012-11-08 14:06:57 -07:00
Barry Haddow
095b307cfc Make sure alignment info is not on for hiero 2012-11-08 18:16:53 +00:00
Barry Haddow
12786dd58f Alignments on by default.
Use TRAINING:include-word-alignment-in-rules = no
to turn them off.
2012-11-08 17:52:10 +00:00
Kenneth Heafield
9b8254a90e Collapse a bunch of Moses libraries into one. 2012-11-08 14:17:15 +00:00
Kenneth Heafield
e9eb7dd021 More shared build fixes 2012-11-07 23:28:42 +01:00
Kenneth Heafield
d7ecd0be1a Remove bleu_lib target. 2012-11-07 23:21:59 +01:00
Mark Fishel
01eb79cf6f fixed berkeley parser wrapper's broken output in case of in-text parentheses 2012-11-07 11:18:36 +01:00
Barry Haddow
01c4de24b7 don't delete moses ini specified in config 2012-11-06 10:59:15 +00:00
Kenneth Heafield
cd00219fa4 Missing dependency 2012-11-04 16:26:47 -05:00
Kenneth Heafield
14392acc8f KenLM 36b746 including -w mmap <unk> offset fix 2012-11-04 15:36:42 -05:00
Tetsuo Kiso
96f7b42eb9 Move implementation details from the header to .cpp file.
Also add const to variables that we don't want to change.
2012-11-05 01:24:16 +09:00
Tetsuo Kiso
cccfb9a0c9 Using namespace std in a header file pollutes the global namespace.
Using directives should be put into the implementation files.
2012-11-05 00:43:36 +09:00
Barry Haddow
62fa6d6f28 Feature function interface for use in scoring 2012-11-02 23:30:51 +00:00
Kenneth Heafield
9a1ac30889 Increase paranoia about --kenlm-max-order and --max-factors 2012-10-31 14:48:29 +00:00
Kenneth Heafield
6deacf05ca Not sure why Hieu changed two spaces to a tab 2012-10-31 14:22:30 +00:00
Kenneth Heafield
d2b4442a36 Remove test's dependence on Boost random 2012-10-31 13:51:50 +00:00
Hieu Hoang
840d988ffe compile error on linux gcc 4.5.0 2012-10-30 22:28:32 +00:00
Hieu Hoang
deb694fb7c minor compile error on macosx. size_t != uint64_t 2012-10-30 14:56:20 -07:00
Kenneth Heafield
dc31857bbc Reduce header pollution 2012-10-30 20:25:05 +00:00
Kenneth Heafield
630b4d4ea9 Get more paranoid by checking for headers too 2012-10-30 20:02:59 +00:00
Kenneth Heafield
b6b2e35190 Change test_lib to obey --static 2012-10-30 19:42:11 +00:00
Kenneth Heafield
4b98b0937c Add bzip and xz input for FilePiece KenLM 06f78db2 2012-10-30 19:33:22 +00:00
Rico Sennrich
06126ae6e2 tmcombine: ignore phrase pairs with 0 probability in optimization 2012-10-29 10:29:51 +01:00
Kenneth Heafield
b0a04ae50e Cut PhraseTableMemory loading time by 35%
Before:
user    122.046
sys     3.029
VmPeak: 13091604 kB
VmRSS:  13052228 kB

After double conversion:
user    117.389
sys     3.330
VmPeak: 13091640 kB
VmRSS:  13052204 kB

Plus eliminate boost lexical cast:
user    82.632
sys     3.177
VmPeak: 13088560 kB
VmRSS:  13049056 kB

Plus inline scoreVector:
user    79.396
sys     2.892
VmPeak: 13088560 kB
VmRSS:  13049064 kB
2012-10-28 17:47:22 +00:00
Kenneth Heafield
8a83deeff6 Windows _read and _write int limits / Cong Duy Vu Hoang 2012-10-26 17:11:43 +01:00
Hieu Hoang
d13c761505 perl to cpp 2012-10-25 19:11:03 +01:00
Hieu Hoang
9aeb368af2 perl to cpp 2012-10-25 18:06:07 +01:00
Hieu Hoang
1770b19c11 perl to cpp 2012-10-25 17:58:30 +01:00
Hieu Hoang
3bb4c3994d perl to cpp 2012-10-25 16:30:16 +01:00
Hieu Hoang
33063e8d4b perl to cpp 2012-10-25 16:20:00 +01:00
Hieu Hoang
e35bb2c81f delete some debug info 2012-10-25 14:14:15 +01:00
Kenneth Heafield
f88df8fdcd Windows 2012-10-25 13:01:36 +01:00
Hieu Hoang
6657c5b2b3 perl to cpp 2012-10-24 18:54:41 +01:00
Hieu Hoang
ae97ddc9fe perl to cpp 2012-10-24 17:53:11 +01:00
Hieu Hoang
7a71270be2 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-10-24 10:38:05 +01:00
Hieu Hoang
507b49e0f5 fix marcin's querying of compact rule table 2012-10-24 10:37:52 +01:00