Barry Haddow
956106be0f
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-04-23 08:35:09 +01:00
Barry Haddow
0c2a1f2624
new default mert location
2012-04-23 08:34:41 +01:00
phikoehn
a5a37c0371
minor fixes
2012-04-17 23:41:45 +01:00
phikoehn
2c520fb93c
multi-threaded hierarchical rule extractor
2012-04-17 05:54:48 +01:00
phikoehn
05f02157ab
re-run extract when using ghkm
2012-04-14 22:18:16 +01:00
phikoehn
4d133cf7ff
bug fix
2012-04-12 22:07:26 +01:00
phikoehn
2d47a5637b
minor fixes
2012-04-12 00:25:57 +01:00
phikoehn
bc7bb053d5
scripts to escape moses specific characters
2012-03-23 07:21:17 +00:00
phikoehn
80e756b201
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2012-03-23 07:17:34 +00:00
phikoehn
4048734a59
bug fix to filter hierarchical
2012-03-23 07:17:08 +00:00
Tetsuo Kiso
90543c6c22
Add error check when opening a file.
2012-03-22 21:51:00 +09:00
phikoehn
76d2a19741
only filter rule and reordering tables, if the tables changes, not just when weights or other settings changed
2012-03-22 00:13:02 +00:00
phikoehn
1213b9114a
mop up
2012-03-21 00:38:05 +00:00
phikoehn
048e0f8de4
lotsa minor changes: mostly bug fixes, tokenizer now esacapes special Moses characters (|<>&)
2012-03-20 04:57:37 +00:00
Hieu Hoang
91b2804fbf
xcode
2012-03-15 13:26:54 +07:00
Hieu Hoang
ef390a705f
1. use new gsort, rather than sort, if it is available
...
2. check return value of cat command in extract-parallel in case it runs out of disk space etc
2012-03-11 15:50:46 +07:00
Matous Machacek
d5c78d19da
Added extractorargs parameter
2012-02-29 15:53:44 +01:00
Hieu Hoang
205c1a868b
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-02-27 13:08:41 +00:00
Hieu Hoang
c542a7b77f
compile error from latest zlib header
2012-02-26 17:33:23 +00:00
Ondrej Bojar
5f84b6e074
accept gzipped input files (tested for non-factored phrase-based)
2012-02-24 18:02:50 +01:00
Hieu Hoang
dbb7980a72
cygwin
2012-02-24 14:18:22 +00:00
Hieu Hoang
de9eeab7e9
mac osx compatible split & sort
2012-02-23 13:26:19 +00:00
phikoehn
d3e17f0ebd
fix bug with < and >
2012-02-22 00:49:29 +00:00
Philipp Koehn
faea0c3ea3
bug fixes
2012-02-16 05:14:56 +00:00
Hieu Hoang
7073f7d891
bug fix by Guchun Zhang
2012-02-16 10:28:09 +07:00
Hieu Hoang
7f6f8a99f9
bug fix by Guchun Zhang
2012-02-16 10:26:48 +07:00
Ondrej Bojar
1363583c4f
gzip output phrase-based ttable by default
2012-02-12 00:23:02 +01:00
Hieu Hoang
53b41f7c45
parallel extract
2012-02-09 18:24:49 +07:00
Mark Fishel
527e892d7f
put the e2f table half sorting back into the threaded section for occasional minor speedup
2012-02-09 10:09:44 +01:00
Mark Fishel
3c455c45f1
Made the forking phrase scoring fall back to non-forking behaviour if the --parallel switch is off
2012-02-09 09:34:00 +01:00
Hieu Hoang
b8c1c53e2b
visual studio
2012-02-08 17:57:36 +07:00
Hieu Hoang
fbdab66587
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-02-08 17:26:29 +07:00
Hieu Hoang
ba5316e2e8
parallel scoring
2012-02-08 17:25:42 +07:00
Hieu Hoang
8efd2cb558
visual studio
2012-02-08 13:26:39 +07:00
Hieu Hoang
be1a26c482
input file can be gzipped
2012-02-08 12:51:55 +07:00
root
4e93cda304
make irst training a little more compatible with sri
2012-02-06 16:53:41 +07:00
Barry Haddow
f55c9921e7
Fix to qsub args, from Guchun Zhang
2012-02-04 13:33:47 +00:00
Hieu Hoang
13400918cf
Merge pull request #9 from miska/master
...
Few compilation fixes
2012-02-03 01:25:33 -08:00
Jiri Marsik
1de5d83dac
Separated train-global-lexicon-model into three steps.
...
The script now offers the actions 'list', 'train'
and 'consolidate', which make it more amenable
for parallelization.
2012-02-01 14:16:09 +01:00
Michal Hrusecky
8ab6c7a655
Alway return something in non-void functions
...
There were functions defined as non-void but didn't have return value
for all possible passes. This can result in undefined behavior. Fixed
this issue and returning values that somehow makes sense hopefully.
2012-02-01 14:03:49 +01:00
Phil Williams
d2988effa8
train-model.perl: don't pass --MaxSpan option to rule extractor if
...
using GHKM.
2012-02-01 12:01:24 +00:00
Barry Haddow
1b0cb656e9
error checking
2012-01-31 23:44:44 +08:00
Barry Haddow
e7c497484f
Merge branch 'master' of github.com:moses-smt/mosesdecoder
2012-01-31 15:14:08 +00:00
Barry Haddow
d4d38cd859
error checking
2012-01-31 15:13:59 +00:00
Hieu Hoang
3de86c5724
undo start-translation-id arg, as per email from Sandra Noubours
2012-01-26 21:24:05 +07:00
Hieu Hoang
89d4743bad
rollback accidental commit
2012-01-24 18:04:44 +07:00
Hieu Hoang
5ae2a24878
add --sort-batch-size arg to train-model.perl
2012-01-24 18:00:45 +07:00
phikoehn
df6c71a276
Merge branch 'master' of git://github.com/moses-smt/mosesdecoder
2012-01-24 10:14:04 +00:00
phikoehn
79efdef247
added comments to config files
2012-01-24 10:13:19 +00:00
Phil Williams
5a9607759b
filter-rule-table.py: fix horribly inefficient filtering of rules that
...
contain frequently-occurring terminal sequences
(like [X] -> [X] , [X] , [X] , [X] and [X])
2012-01-23 10:57:56 +00:00