Commit Graph

17109 Commits

Author SHA1 Message Date
Ulrich Germann
403fd9039e Merge pull request #175 from linas/zh
Preliminary Chinese support. I'm not aware of any existing regression tests, so we should watch out for error reports.
2017-01-11 17:41:30 +00:00
Linas Vepstas
8fdd19310b Update to applly CJK processing conditionally. 2017-01-11 11:23:54 -06:00
Hieu Hoang
763040238a Merge ../mosesdecoder.perf 2017-01-11 10:57:05 +00:00
Hieu Hoang
88af99ffce add FF param args 2017-01-11 10:37:15 +00:00
Hieu Hoang
64a22f0514 use ken's method to mem map target phrases 2017-01-11 10:30:05 +00:00
Hieu Hoang
1feb5a389f move target phrase mem map into query engine 2017-01-10 19:27:10 +00:00
Hieu Hoang
b8db6070f9 use ken's read map 2017-01-10 18:54:34 +00:00
Hieu Hoang
cf3b51d544 use ken's read map 2017-01-10 18:49:44 +00:00
Hieu Hoang
48f1bac05d use ken's read map 2017-01-10 18:39:16 +00:00
Hieu Hoang
eb8fde24b0 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2017-01-10 17:23:12 +00:00
MosesAdmin
db22064bbc daily automatic beautifier 2017-01-10 16:55:38 +00:00
Hieu Hoang
4910a38590 enable C++11 2017-01-10 16:31:33 +00:00
Hieu Hoang
1603c25bab minor rename 2017-01-09 18:56:25 +00:00
Linas Vepstas
2e48f83ab4 Handle punctuation+CJK combinations. 2017-01-08 10:08:53 -06:00
Hieu Hoang
4d13377ce8 compile error 2017-01-07 20:36:41 +00:00
Linas Vepstas
6fb2c97029 Bug-fix: regular Western sentence enders not recognized. 2017-01-05 23:29:00 -06:00
MosesAdmin
9fa538ce5c daily automatic beautifier 2017-01-06 00:00:50 +00:00
Lane Schwartz
171edca393 Merge 2017-01-05 15:53:04 -06:00
Lane Schwartz
1f744ecd9b Fixed a subtle possibly thread-related thread 2017-01-05 15:48:30 -06:00
Linas Vepstas
bd9d12351b Create a Cantonese version, distinct from Mandarin.
The content is identical, at this moment, but having distinct
langauge suffixes solves processing-pipeline problems later on.
2017-01-05 12:53:21 -06:00
Linas Vepstas
1933bcbf33 Whoops, revert cut-n-paste damage in previous commit. 2017-01-05 11:39:01 -06:00
Linas Vepstas
203c7c6387 Preliminary support for Chinese. 2017-01-05 11:34:38 -06:00
Linas Vepstas
144f43495e Preliminary support for Chinese.
Also, cleanup some of the comments.
2017-01-05 11:33:10 -06:00
Ulrich Germann
138ebf1f1e Merge pull request #174 from linas/cl
Purely cosmetic cleanup.
2017-01-05 16:17:01 +00:00
Linas Vepstas
9f5500a3a8 oops. 2017-01-05 10:09:34 -06:00
Linas Vepstas
ab6816f9a7 Purely cosmetic cleanup.
Use same indentation style throughout; wrap long lines; capitalize
sentences; add punctuation; remove trailing whitespace.
2017-01-05 10:08:06 -06:00
Ulrich Germann
f2134cf435 Merge pull request #173 from linas/lt
More abbreviations for Lithuanian.
2017-01-05 06:09:29 +00:00
Linas Vepstas
d10ba6f049 More abbreviations for LLithuanian. 2017-01-04 23:52:28 -06:00
Linas Vepstas
3ef84b133c More abbreviations 2017-01-04 22:30:53 -06:00
Ulrich Germann
f04da9bcd5 Merge pull request #172 from linas/lt
New file: Lithuanian
2017-01-05 05:12:07 +01:00
Linas Vepstas
2a5e40ed60 New file: Lithuanian 2017-01-04 22:01:45 -06:00
Hieu Hoang
1da0dc249c Merge branch 'master' of github.com:moses-smt/mosesdecoder 2017-01-03 11:07:06 +00:00
Hieu Hoang
02772c07de revert changes to Distortion FF 2017-01-03 11:06:26 +00:00
MosesAdmin
80bd559757 daily automatic beautifier 2017-01-03 00:00:36 +00:00
Hieu Hoang
ff12a13eaa re-tune if decoder changed. eg moses -> moses2 2017-01-02 16:37:56 -05:00
Hieu Hoang
ab2e48415f add back -text-type for EMS 2017-01-02 15:55:33 -05:00
Lane Schwartz
a18b6676b1 Allow user to specify whether PhraseDictionaryMemoryPerSentenceOnDemand are probability values or not 2017-01-02 14:22:26 -06:00
Lane Schwartz
76a8850487 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2017-01-02 12:57:58 -06:00
Lane Schwartz
578e65298f Add InMemoryPerSentenceOnDemandLM 2017-01-02 12:57:52 -06:00
Lane Schwartz
999d6b6371 Added labelled score breakdown to translation options in TranslationRequest.
This will enable a client to get the feature value(s) associated with a particular feature for a particular translation option
2017-01-02 12:52:01 -06:00
Hieu Hoang
cf93594af9 re-implement -feature-overwrite 2017-01-02 12:44:26 +00:00
Hieu Hoang
29b0072eda CreateProbingPT2 -> CreateProbingPT 2017-01-02 06:02:54 -05:00
Hieu Hoang
a74ce0ef8e Merge branch 'perf_moses2' of github.com:hieuhoang/mosesdecoder into perf_moses2 2017-01-01 22:56:38 +00:00
Hieu Hoang
d4642a34c1 add completed-hypo to Distortion FF 2017-01-01 22:54:48 +00:00
Ulrich Germann
d3320cc290 Merge pull request #171 from doried-a-a/master
Fixing errors while building with oxlm
2016-12-30 13:10:19 +01:00
Doried Abd-Allah
347980fd42 fixing errors while building with oxlm: renamed iptr to boost_iptr because of a conflict with eigen library required by oxlm, added boost_serialization to oxlm requirements in jamroot 2016-12-29 15:16:07 +02:00
Hieu Hoang
6c075b67c5 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2016-12-29 12:07:32 +00:00
Hieu Hoang
06a0ae18f2 Merge ../mosesdecoder.perf 2016-12-29 12:04:15 +00:00
Hieu Hoang
c30b28f43b Edge case of wall at the end of sentence /Mike Ladwig 2016-12-29 12:03:59 +00:00
Hieu Hoang
e14a71c3ea debugging messages 2016-12-28 10:57:19 +00:00