Commit Graph

1040 Commits

Author SHA1 Message Date
Hieu Hoang
1dea58e945 separate parameters into it's own class 2015-01-25 15:02:33 +00:00
Hieu Hoang
5d2b0224d6 Jamfile for tokenizer 2015-01-25 14:00:35 +00:00
Kenneth Heafield
98c352ed3a Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2015-01-23 13:38:35 -05:00
akimbal1
d38dcd89bb add glib-2.0 for better unicodification and faster implementation 2015-01-23 13:35:09 -05:00
Hieu Hoang
4f322242e9 eclipse 2015-01-22 22:17:50 +00:00
Hieu Hoang
a6cef9382c eclipse 2015-01-22 22:06:53 +00:00
Kenneth Heafield
1dce55f413 C++ tokenizer based on RE2. Not by me.
Some differences from Moses tokenizer:  fraction characters count as numbers, _ handling, URLs
Currently 3x slower than perl :'(.  Looking to make it faster by composing regex substitutions.
TODO eliminate sprintf and fixed-size buffers.
2015-01-22 12:25:02 +01:00
Kenneth Heafield
e30065072e C++ tokenizer based on RE2. Not by me.
Some differences from Moses tokenizer:  fraction characters count as numbers, _ handling, URLs
Currently 3x slower than perl :'(.  Looking to make it faster by composing regex substitutions.
TODO eliminate sprintf and fixed-size buffers.
2015-01-21 12:23:44 -05:00
Hieu Hoang
bb55949eef call Manager::OutputAlignment() 2015-01-10 09:56:50 +00:00
Hieu Hoang
be0ab92d16 delete oov pt 2015-01-09 22:32:08 +00:00
Hieu Hoang
782ac85674 allow mira compilation for Eva 2015-01-08 12:37:34 +00:00
Hieu Hoang
13ec6060b0 move mira code to contrib 2015-01-08 11:49:53 +00:00
Hieu Hoang
b9bef2fc44 add oovpt 2015-01-07 12:18:09 +04:00
Hieu Hoang
3b3f11365d delete UserMessage. Too difficult to police 2015-01-07 10:01:10 +04:00
Hieu Hoang
1e0a2835bf add oovpt 2015-01-04 19:10:48 +05:30
Hieu Hoang
0552a79b1e consistent constructor for all managers 2015-01-03 00:10:15 +05:30
Hieu Hoang
ba166f109c moving more stuff out of IOWrapper 2014-12-30 18:53:30 +05:30
Hieu Hoang
f865e7e43c move OutputInput() to Hypothesis class 2014-12-28 22:09:38 +05:30
Ratish Puduppully
61c0c752b3 updated with links to changes 2014-12-23 13:39:22 +05:30
Nicola Bertoldi
4e77665d30 better handling of cache-based models with inconsistent parameters 2014-12-15 17:42:41 +01:00
Nicola Bertoldi
e4eb201c52 merged master into dynamic-models and solved conflicts 2014-12-13 12:52:47 +01:00
Hieu Hoang
fad3ef687a move OutputBest() to Syntax::Manager 2014-12-10 11:01:56 +00:00
Hieu Hoang
a4c9e5f920 eclipse 2014-12-09 17:58:23 +00:00
Hieu Hoang
23ca29a2ea add Decode to API framework 2014-12-05 17:59:53 +00:00
Hieu Hoang
29ead5be7b move n-best code for phrase-based from IOWrapper to Manager 2014-12-02 14:38:03 +00:00
Hieu Hoang
f49294f5ba eclipse 2014-11-27 18:43:46 +00:00
Barry Haddow
805eb551be Insert correct settings for nbest list. Not threadsafe though. 2014-11-25 16:48:37 +00:00
Hieu Hoang
7331d7a46c eclipse 2014-11-24 13:56:46 +00:00
Hieu Hoang
efed89d0e6 eclipse 2014-11-24 13:46:08 +00:00
Hieu Hoang
c0be182bfa makemteval and small change to tokenizer. /Tom Hoar and Tomas Fulajtar 2014-11-21 13:55:13 +00:00
Hieu Hoang
2711410712 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-11-20 17:38:17 +00:00
XapaJIaMnu
52c520c042 Resolve merge conflicts 2014-11-20 15:50:32 +00:00
Hieu Hoang
c346a4b198 Add rt library 2014-11-20 15:02:05 +00:00
Marcin Junczys-Dowmunt
6a52bfc199 Added -lpthread -lrt 2014-11-19 16:57:33 +01:00
Nicola Bertoldi
46596ed49a Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-11-18 15:16:16 +01:00
Nicola Bertoldi
92c2d3e2a4 added back-off combination technique 2014-11-18 15:16:05 +01:00
Nicola Bertoldi
da15afd57c initial work to enable mosesserver for online adaptation 2014-11-18 15:06:02 +01:00
Hieu Hoang
070afadbcd eclipse 2014-11-17 22:40:36 +00:00
Paul Baltescu
35401f7dd3 Merge branch 'bilingual-lm' of github.com:moses-smt/mosesdecoder into bilingual-lm 2014-11-14 12:39:02 +00:00
Paul Baltescu
6f9d59129f Rename LBLLM -> OxLM. 2014-11-13 16:07:38 +00:00
Hieu Hoang
41b207e623 fix Jamfile 2014-11-13 15:51:46 +00:00
Hieu Hoang
6dda0d19cf add Bilingual LM class 2014-11-13 15:50:05 +00:00
Hieu Hoang
28caa93d43 eclipse 2014-11-10 18:18:49 +00:00
Hieu Hoang
e1092c0dad merge 2014-11-07 14:35:36 +00:00
Hieu Hoang
832fba09c8 eclipse 2014-11-04 15:04:26 +00:00
Nikolay Bogoychev
35a007e232 Merge branch 'master' into bilingual-lm 2014-10-27 11:56:56 +00:00
Marcin Junczys-Dowmunt
3d8526d72c merged in from wipoNew 2014-10-24 10:45:52 +02:00
Marcin Junczys-Dowmunt
8b67e4552e Changed wrong usage message 2014-10-21 20:08:17 +02:00
Barry Haddow
562cf7e007 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-10-21 15:11:22 +01:00
Barry Haddow
b4f26e9f5e rephraser 2014-10-21 15:10:50 +01:00