moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 22:14:57 +03:00
Code Issues Packages Projects Releases Wiki Activity
13,016 Commits 136 Branches 26 Tags 147 MiB
dfd3a53e9e
Commit Graph

1818 Commits

Author SHA1 Message Date
Philipp Koehn
3740c9f248 bug fix mmsapt training 2014-09-21 06:02:35 +01:00
Philipp Koehn
a8659d1399 support for specified weights 2014-09-21 06:01:16 +01:00
Philipp Koehn
acefdb0262 bug fix for final-step 2014-09-21 05:59:21 +01:00
Rico Sennrich
0861b464c5 use square brackets with output format '--brackets' (for cleaner escaping and consistency with decoder tree output) 2014-09-15 14:37:52 +01:00
Rico Sennrich
4da0ffc926 use configured scorer (and not always BLEU) for --return-best-dev 2014-09-12 19:17:23 +02:00
Ondrej Bojar
14449b3601 towards a simple line-oriented dump of FSA 2014-09-11 14:50:59 +02:00
Ondrej Bojar
c2fa95dfd8 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-09-10 14:35:52 +02:00
Ondrej Bojar
01e364d1e6 use --n=0 to check coverage of full sents 2014-09-10 14:33:55 +02:00
Hieu Hoang
eb75e58820 Merge pull request #72 from flammie/master 
Add Finnish non-breaking prefixes
 2014-09-04 16:31:14 +01:00
Flammie Pirinen
1da3df93bc fix location and remove english notes 2014-09-04 16:01:10 +01:00
Nadir
0d59d0e456 Safe System Function OSM Training 2014-09-01 11:48:27 +01:00
Michael Denkowski
b8c9ae2c55 Update models named "Dynamic..." 2014-08-29 14:40:20 -04:00
Michael Denkowski
9098f3a8b4 Support simulated post-editing with MultiModel 2014-08-19 16:20:35 -04:00
Philipp Koehn
a574454635 bug fix with delete crashed step output files 2014-08-14 14:14:42 -04:00
Philipp Koehn
7a087f24df also delete interrupted steps 2014-08-14 10:15:58 -04:00
Michael Denkowski
300de5d041 Text size limits jobs 2014-08-13 16:51:20 -04:00
Michael Denkowski
057066ea0e Minor fixes for simulated post-editing with mert-moses.pl 2014-08-13 15:58:51 -04:00
Hieu Hoang
94c44c03d5 merge 2014-08-13 18:03:05 +01:00
Matthias Huck
c27cbf55ea source labels: integration into EMS 2014-08-07 21:02:51 +01:00
Hieu Hoang
23f10cc73f move notice about czech prefixes to share/README 2014-08-06 15:03:37 +01:00
Michael Denkowski
9ad59e2d69 Header and some instructions 2014-08-05 15:11:35 -04:00
Michael Denkowski
e7c36ee804 Simulated post-editing merge: XML update, parallel SPE script, MERT 2014-08-05 14:20:00 -04:00
Philipp Koehn
7f41bbba67 changes to protecting specified patterns (with example patterns) 2014-08-03 18:22:27 -04:00
Philipp Koehn
e3b26f334f grrrr... 2014-07-31 21:02:08 -04:00
Philipp Koehn
e5bbdcae9e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-31 20:53:26 -04:00
Philipp Koehn
c795098963 added flush switch (-b) to normalize-punctuation.perl 2014-07-31 20:53:04 -04:00
Matthias Huck
3a5dee12e8 implementation of phrase orientation in GHKM extraction 
(...but a corresponding feature function for the chart-based decoder has not been written yet)
 2014-07-28 18:27:12 +01:00
phikoehn
573076976f added transliteration into ems example config, minor fixes 2014-07-23 15:44:55 +01:00
phikoehn
2d11fe3916 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-07-23 15:40:04 +01:00
phikoehn
2239501b21 allow specification of weights for lm interpolation 2014-07-23 15:39:42 +01:00
Barry Haddow
bfb5cca518 Merge branch 'master' of github.com:moses-smt/mosesdecoder 
Conflicts:
	util/read_compressed.cc
 2014-07-23 09:40:55 +01:00
Philipp Koehn
55ae15a6f8 integration of Uli Germann's memory mapped suffix array phrase table into EMS 2014-07-22 10:12:14 -04:00
Philipp Koehn
36919b53a7 example files for memory mapped suffix array phrase table by Uli Germann 2014-07-22 10:10:34 -04:00
Barry Haddow
2a611194a2 reinstate new kbmira args 2014-07-21 11:43:37 +01:00
Ulrich Germann
5915e2b1cb Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-07-17 15:53:07 +01:00
Hieu Hoang
a3bd695cd4 factor for oov is 0, not <unk> - interferes with source input. Add extra argument to lowercase input words or not 2014-07-13 02:54:58 +01:00
Ulrich Germann
4d41211c2c Major overhaul of Mmsapt. Reorganization of old and addition of new features in phrase tables. Many critical bug fixes. 2014-07-09 02:41:28 +01:00
Flammie Pirinen
42511ece3f Add Finnish abbreviations from omorfi 2014-06-24 16:14:43 +01:00
Hieu Hoang
f95a1bb75b more shards 2014-06-23 09:36:13 -04:00
Matthias Huck
318323049d Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-16 15:11:07 +01:00
Matthias Huck
c2644c9a08 typo in log output 2014-06-16 15:10:53 +01:00
Hieu Hoang
f2d3f57d07 Merge branch 'hieu' of ../mosesdecoder.hieu 2014-06-16 10:57:02 +01:00
Ulrich Germann
5ff14f9798 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 2014-06-14 13:29:52 +01:00
Hieu Hoang
5c57702664 merge 2014-06-13 17:08:22 +01:00
XapaJIaMnu
5c6c44291d Python2 scripts should require python2 specifically 2014-06-13 15:44:30 +01:00
Hieu Hoang
eb78782c5d merge with master 2014-06-13 10:35:35 +01:00
Ulrich Germann
65a8857dc0 Bug fixes in scripts/server/moses.py. 2014-06-12 18:33:53 +01:00
Matthias Huck
02848112d8 experiment.meta: skip-parse and mock-parse 2014-06-11 19:06:04 +01:00
phikoehn
89a9c410c9 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-11 13:44:22 +01:00
phikoehn
45648d03b9 support for lmplz training of osm in ems 2014-06-11 13:44:02 +01:00
Hieu Hoang
da84cce8c4 Merge github.com:moses-smt/mosesdecoder into hieu 2014-06-09 16:20:29 +01:00
Rico Sennrich
169c3fce38 convert CoNNL-X to Moses XML format 2014-06-09 15:24:41 +01:00
Hieu Hoang
45ed0a5b1f Merge ../mosesdecoder into hieu 2014-06-08 13:22:34 +01:00
phikoehn
76859cf37b default OSM training to lmplz (kenlm) 2014-06-08 06:13:46 +01:00
phikoehn
1a82535cf8 default kenlm training and inference in recaser 2014-06-06 21:54:42 +01:00
Hieu Hoang
091ce3f016 Merge ../mosesdecoder into hieu 2014-06-06 17:25:26 +01:00
Philipp Koehn
fc8e588f25 kbmira bug fix & factor handling 2014-06-06 14:20:57 +01:00
phikoehn
ac7670c5e7 minor bugs with factors 2014-06-06 14:14:35 +01:00
Hieu Hoang
b589c3d5c2 Merge ../mosesdecoder into hieu 2014-06-06 11:11:47 +01:00
phikoehn
7fc3ccd968 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-05 21:37:20 +01:00
Philipp Koehn
243004bda6 utf8 compatible 2014-06-05 21:36:18 +01:00
phikoehn
ceadacd3af Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-06-05 21:33:35 +01:00
Philipp Koehn
15288213be allow < > in factors 2014-06-05 21:31:09 +01:00
Hieu Hoang
a17a45fa7f span length 2014-06-05 17:20:38 +01:00
Hieu Hoang
ce2a69ba25 Merge ../mosesdecoder into hieu 2014-06-05 17:18:26 +01:00
Kenneth Heafield
d82bd475a2 Nadir Durrani asked me to add this script 2014-06-04 11:27:36 -07:00
Hieu Hoang
8065bf7467 add span length as a score option to train-model.perl 2014-06-04 18:06:06 +01:00
Hieu Hoang
8e2c4a89c0 Merge ../mosesdecoder into hieu 2014-06-04 12:53:06 +01:00
Barry Haddow
ea37abbf45 lm query output has been modified 2014-06-03 22:13:25 +01:00
Ulrich Germann
9c27dc08e9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
Conflicts:
	moses/FF/ConstrainedDecoding.cpp
 2014-06-03 18:55:53 +01:00
Hieu Hoang
038f213d10 Merge ../mosesdecoder into hieu 2014-06-03 13:24:12 +01:00
Philipp Koehn
b1d09352ca change default language model training to kenlm 2014-06-02 22:20:16 -04:00
Hieu Hoang
5723526832 script to remove non-printing characters once and for all 2014-05-31 00:24:15 +01:00
Hieu Hoang
e64417eedf Merge branch 'hieu' of github.com:hieuhoang/mosesdecoder into hieu 2014-05-30 18:37:45 +01:00
Hieu Hoang
6c47406309 script to remove all non-printing chars once and for all 2014-05-30 18:37:33 +01:00
Ulrich Germann
0b6a0e42d6 scripts/generic/bsbleu.py: Bug fix. 2014-05-30 13:51:22 +01:00
Ulrich Germann
d3b058ca4b scripts/generic/bsbleu.py: Confidence interval can now be set via command line argument. 2014-05-30 13:50:10 +01:00
Ulrich Germann
67be805211 Added scripts/generic/bsbleu.py: bleu score computation with confidence intervals via boostrap resampling. 2014-05-30 13:12:07 +01:00
Hieu Hoang
a270811d84 Merge ../mosesdecoder into hieu 2014-05-30 09:31:14 +01:00
phikoehn
9a91f423e4 fixed error 2014-05-30 08:30:06 +01:00
Hieu Hoang
d658caeb00 Merge ../mosesdecoder into hieu 2014-05-30 05:41:49 +01:00
Hieu Hoang
9615f4636c change error to warning. Seems to work ok with recaser 2014-05-30 05:40:22 +01:00
Hieu Hoang
aea439eccb Merge ../mosesdecoder into hieu 2014-05-28 22:43:44 +01:00
Philipp Koehn
7adf705a9e Merge branch 'master' of https://github.com/moses-smt/mosesdecoder 
merge with upstram
 2014-05-28 03:59:16 -04:00
Philipp Koehn
1b26f37f9a allow specification of final step and final outcome in experiment.perl 2014-05-28 03:58:14 -04:00
phikoehn
f7ec76654e minor in experiment.meta: proper multi-bleu, beautify 2014-05-28 01:39:53 +01:00
phikoehn
f4651751e6 Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-05-28 01:39:00 +01:00
phikoehn
d93da293ad transliteration with multiple language models, other minor 2014-05-28 01:38:26 +01:00
Barry Haddow
00b1d83841 Remove debug flag 2014-05-27 08:55:05 +01:00
Hieu Hoang
1cbbf128cd Merge ../mosesdecoder into hieu 2014-05-26 17:51:51 +01:00
Barry Haddow
66b5d2f3fd parse hgmira output correctly 2014-05-26 11:03:28 +01:00
Hieu Hoang
cfe22c29bc Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-05-25 10:06:51 +01:00
Hieu Hoang
b724a90d59 more edinburgh servers 2014-05-25 10:06:40 +01:00
Philipp Koehn
2876613973 fixes to delete-crashed and delete-run 2014-05-23 15:02:22 -04:00
Philipp Koehn
85ea9d552a fixes to delete-crashed and delete-run 2014-05-23 15:01:53 -04:00
Hieu Hoang
42a1989f86 generic parallization that take stdin and output to stdout. For parsing 2014-05-23 01:03:29 +01:00
Hieu Hoang
2b7cd6b18a generic parallization that take stdin and output to stdout. For parsing 2014-05-23 01:02:35 +01:00
Hieu Hoang
b9566a1b99 Merge ../mosesdecoder into hieu 2014-05-22 21:24:38 +01:00
Hieu Hoang
3dc7bec12d Merge branch 'master' of github.com:moses-smt/mosesdecoder 2014-05-22 21:23:50 +01:00
Hieu Hoang
403a473222 utf8 encoding 2014-05-22 21:23:31 +01:00