Commit Graph

760 Commits

Author SHA1 Message Date
Barry Haddow
956106be0f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-04-23 08:35:09 +01:00
Barry Haddow
0c2a1f2624 new default mert location 2012-04-23 08:34:41 +01:00
phikoehn
a5a37c0371 minor fixes 2012-04-17 23:41:45 +01:00
phikoehn
2c520fb93c multi-threaded hierarchical rule extractor 2012-04-17 05:54:48 +01:00
phikoehn
05f02157ab re-run extract when using ghkm 2012-04-14 22:18:16 +01:00
phikoehn
4d133cf7ff bug fix 2012-04-12 22:07:26 +01:00
phikoehn
2d47a5637b minor fixes 2012-04-12 00:25:57 +01:00
phikoehn
bc7bb053d5 scripts to escape moses specific characters 2012-03-23 07:21:17 +00:00
phikoehn
80e756b201 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-03-23 07:17:34 +00:00
phikoehn
4048734a59 bug fix to filter hierarchical 2012-03-23 07:17:08 +00:00
Tetsuo Kiso
90543c6c22 Add error check when opening a file. 2012-03-22 21:51:00 +09:00
phikoehn
76d2a19741 only filter rule and reordering tables, if the tables changes, not just when weights or other settings changed 2012-03-22 00:13:02 +00:00
phikoehn
1213b9114a mop up 2012-03-21 00:38:05 +00:00
phikoehn
048e0f8de4 lotsa minor changes: mostly bug fixes, tokenizer now esacapes special Moses characters (|<>&) 2012-03-20 04:57:37 +00:00
Hieu Hoang
91b2804fbf xcode 2012-03-15 13:26:54 +07:00
Hieu Hoang
ef390a705f 1. use new gsort, rather than sort, if it is available
2. check return value of cat command in extract-parallel in case it runs out of disk space etc
2012-03-11 15:50:46 +07:00
Matous Machacek
d5c78d19da Added extractorargs parameter 2012-02-29 15:53:44 +01:00
Hieu Hoang
205c1a868b Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-27 13:08:41 +00:00
Hieu Hoang
c542a7b77f compile error from latest zlib header 2012-02-26 17:33:23 +00:00
Ondrej Bojar
5f84b6e074 accept gzipped input files (tested for non-factored phrase-based) 2012-02-24 18:02:50 +01:00
Hieu Hoang
dbb7980a72 cygwin 2012-02-24 14:18:22 +00:00
Hieu Hoang
de9eeab7e9 mac osx compatible split & sort 2012-02-23 13:26:19 +00:00
phikoehn
d3e17f0ebd fix bug with < and > 2012-02-22 00:49:29 +00:00
Philipp Koehn
faea0c3ea3 bug fixes 2012-02-16 05:14:56 +00:00
Hieu Hoang
7073f7d891 bug fix by Guchun Zhang 2012-02-16 10:28:09 +07:00
Hieu Hoang
7f6f8a99f9 bug fix by Guchun Zhang 2012-02-16 10:26:48 +07:00
Ondrej Bojar
1363583c4f gzip output phrase-based ttable by default 2012-02-12 00:23:02 +01:00
Hieu Hoang
53b41f7c45 parallel extract 2012-02-09 18:24:49 +07:00
Mark Fishel
527e892d7f put the e2f table half sorting back into the threaded section for occasional minor speedup 2012-02-09 10:09:44 +01:00
Mark Fishel
3c455c45f1 Made the forking phrase scoring fall back to non-forking behaviour if the --parallel switch is off 2012-02-09 09:34:00 +01:00
Hieu Hoang
b8c1c53e2b visual studio 2012-02-08 17:57:36 +07:00
Hieu Hoang
fbdab66587 Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-02-08 17:26:29 +07:00
Hieu Hoang
ba5316e2e8 parallel scoring 2012-02-08 17:25:42 +07:00
Hieu Hoang
8efd2cb558 visual studio 2012-02-08 13:26:39 +07:00
Hieu Hoang
be1a26c482 input file can be gzipped 2012-02-08 12:51:55 +07:00
root
4e93cda304 make irst training a little more compatible with sri 2012-02-06 16:53:41 +07:00
Barry Haddow
f55c9921e7 Fix to qsub args, from Guchun Zhang 2012-02-04 13:33:47 +00:00
Hieu Hoang
13400918cf Merge pull request #9 from miska/master
Few compilation fixes
2012-02-03 01:25:33 -08:00
Jiri Marsik
1de5d83dac Separated train-global-lexicon-model into three steps.
The script now offers the actions 'list', 'train'
and 'consolidate', which make it more amenable
for parallelization.
2012-02-01 14:16:09 +01:00
Michal Hrusecky
8ab6c7a655 Alway return something in non-void functions
There were functions defined as non-void but didn't have return value
for all possible passes. This can result in undefined behavior. Fixed
this issue and returning values that somehow makes sense hopefully.
2012-02-01 14:03:49 +01:00
Phil Williams
d2988effa8 train-model.perl: don't pass --MaxSpan option to rule extractor if
using GHKM.
2012-02-01 12:01:24 +00:00
Barry Haddow
1b0cb656e9 error checking 2012-01-31 23:44:44 +08:00
Barry Haddow
e7c497484f Merge branch 'master' of github.com:moses-smt/mosesdecoder 2012-01-31 15:14:08 +00:00
Barry Haddow
d4d38cd859 error checking 2012-01-31 15:13:59 +00:00
Hieu Hoang
3de86c5724 undo start-translation-id arg, as per email from Sandra Noubours 2012-01-26 21:24:05 +07:00
Hieu Hoang
89d4743bad rollback accidental commit 2012-01-24 18:04:44 +07:00
Hieu Hoang
5ae2a24878 add --sort-batch-size arg to train-model.perl 2012-01-24 18:00:45 +07:00
phikoehn
df6c71a276 Merge branch 'master' of git://github.com/moses-smt/mosesdecoder 2012-01-24 10:14:04 +00:00
phikoehn
79efdef247 added comments to config files 2012-01-24 10:13:19 +00:00
Phil Williams
5a9607759b filter-rule-table.py: fix horribly inefficient filtering of rules that
contain frequently-occurring terminal sequences
(like [X] -> [X] , [X] , [X] , [X] and [X])
2012-01-23 10:57:56 +00:00