Commit Graph

1628 Commits

Author SHA1 Message Date
Ulrich Germann
0b6a0e42d6 scripts/generic/bsbleu.py: Bug fix. 2014-05-30 13:51:22 +01:00
Ulrich Germann
d3b058ca4b scripts/generic/bsbleu.py: Confidence interval can now be set via command line argument. 2014-05-30 13:50:10 +01:00
Ulrich Germann
67be805211 Added scripts/generic/bsbleu.py: bleu score computation with confidence intervals via boostrap resampling. 2014-05-30 13:12:07 +01:00
Ulrich Germann
365a2ae95d Bug fix in scripts/server/sim-pe.py. 2014-05-19 23:58:54 +01:00
Ulrich Germann
59ddfdfaa0 Added server port number as a command line option to sim-pe.py.
This is important to allow running independent servers on the same machine.
Moses server (in moses.py) will not look for a free port any more if the
port specified is not available.
2014-05-19 21:41:32 +01:00
Ulrich Germann
a79ba985e9 Code refactoring of scripts/server/sim-pe.py. 2014-05-18 21:48:17 +01:00
Ulrich Germann
5c90a09d5a Initial check-in of moses.py 2014-05-18 21:45:42 +01:00
Ulrich Germann
3d4ab5a0d9 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into dynamic-phrase-tables 2014-04-28 10:22:12 +01:00
Ulrich Germann
7c145d045b Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	contrib/server/Jamfile
	contrib/server/mosesserver.cpp
2014-04-28 10:00:07 +01:00
Philipp Koehn
fa85d15e31 relative links to javascript sub directory in ems web interface 2014-04-23 16:56:10 -04:00
phikoehn
4ee4e07c1b minor ems fixes 2014-04-23 13:50:08 +01:00
Hieu Hoang
76a4609cff add script to creat pt with only certain scores 2014-04-20 23:30:09 +01:00
Nadir Durrani
d90aaf1018 Z 2014-04-16 17:40:49 +01:00
Nadir Durrani
5e3e50d4ec In-Decoding Transliteration Module 2014-04-16 17:28:49 +01:00
Ulrich Germann
26454afef7 Added -b switch to pretokenizer to allow disabling of buffering. 2014-04-16 03:28:16 +01:00
Ulrich Germann
fbb4b59084 Added option to disable output buffering to split-sentences.perl. 2014-04-16 02:40:23 +01:00
Ulrich Germann
21f141ce0d Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	moses/InputPath.cpp
	moses/Word.cpp
2014-04-08 14:58:29 +01:00
Ulrich Germann
872facd171 Avoid errors in truecaser if input isn't factored and contains vertical bars. 2014-04-05 15:39:00 +01:00
Ulrich Germann
b1b9f6cfa2 Additions / changes to Moses server so that it can be used for Moses tuning. 2014-04-03 20:38:14 +01:00
Ulrich Germann
467b5d93e8 Additions / changes to mosesserver.cpp so that it can be used in parameter tuning. 2014-04-03 20:35:26 +01:00
Rico Sennrich
c8682e9420 target-syntax: use SoftMatchingFeature to assign non-terminal to unknown words 2014-03-24 14:57:24 +00:00
Phil Williams
cea86d6750 Transliteration support for syntax models. 2014-03-21 22:13:38 +00:00
Hieu Hoang
1c6061e781 bug when adding reordering model to ini file /jian zhang 2014-03-19 00:27:59 +00:00
Hieu Hoang
c501e5fab6 accidental error in perl script 2014-03-14 09:04:49 +00:00
Nadir Durrani
054a648713 Transliteration Script - Modifications 2014-03-13 13:10:38 +00:00
Ulrich Germann
a7c85780ee Merge branch 'master' into dynamic-phrase-tables
Conflicts:
	phrase-extract/score-main.cpp
2014-03-10 14:25:45 +00:00
Rico Sennrich
01bc3c111e swap position of alignment and scores in phrase table halves (before consolidate step).
ensures that multiple hierarchical rules with same source/target phrase, but different alignment, are sorted correctly
2014-03-02 16:55:42 +00:00
Ulrich Germann
3f678fa689 Updated pretokenizer for French. 2014-02-25 03:10:58 +00:00
Ulrich Germann
e70766a6de Preprocessor for tokenization that fixes known errors in the raw input. 2014-02-22 00:28:33 +00:00
Ulrich Germann
d3d14ccf3d - added option -no-escape to skip escaping of special characters
- fixed bug in aggressive tokenization
  (est-a-dire was split as est @-@ a-dire
              instead of   est @-@ a @-@ dire)
2014-02-21 14:14:03 +00:00
Ulrich Germann
ef2ef881a4 Merge branch 'dynamic-phrase-tables' of file:///home/germann/git/mosesdecoder into dynamic-phrase-tables 2014-02-21 01:04:02 +00:00
Hieu Hoang
641145a5c6 Merge pull request #59 from akholy/master
Update train-model.perl
2014-02-18 16:52:26 +00:00
Rico Sennrich
2ac7694f7e copy weights of features with 'tuneable=false' to final config (now also works with -return-best-dev) 2014-02-13 14:19:40 +00:00
phikoehn
049be8b71c Merge branch 'master' of ssh://github.com/moses-smt/mosesdecoder 2014-02-12 21:01:09 +00:00
phikoehn
d6b62db5b1 fix bug if interpolated lm on different factors 2014-02-12 21:00:55 +00:00
Ulrich Germann
a74d7e6095 Bug fix? 2014-02-08 17:54:48 +00:00
Rico Sennrich
ee06a0f652 don't complain if input contains non-escaped '<' or '>', but is not XML 2014-02-08 15:43:00 +00:00
Matthias Huck
65811a0325 tree fragments: tiny issues with the extraction pipeline 2014-02-03 18:13:10 +00:00
Rico Sennrich
d26fe4cc4d fix truecaser with XML input (didn't do anything depending on formatting/whitespace) 2014-01-29 23:01:53 +00:00
Hieu Hoang
b6d47733da remove duplicate spaces caused when XML are stripped 2014-01-24 18:09:55 +00:00
Hieu Hoang
dc3d5b8d38 source labelling for test set. 2014-01-24 16:33:30 +00:00
Hieu Hoang
878e7ab899 source labelling for tuning set. More debugging message in filtering script 2014-01-24 16:21:47 +00:00
Ahmed El Kholy
1ec14d1c6e Update train-model.perl
When I was working with factored models, my experiments failed. After some invistigation, I discovered that the delimiter is hardcoded in several places to "|" so I changed it to $___FACTOR_DELIMITER
2014-01-23 22:38:44 -05:00
Hieu Hoang
6a10f8ce71 corrected phrase-table name / type mixup when creating filtering script 2014-01-23 17:09:56 +00:00
Hieu Hoang
05de672bd8 need to 'label' target side too 2014-01-21 19:21:24 +00:00
Hieu Hoang
27152ccce4 add source labeller to EMS 2014-01-20 23:26:06 +00:00
Hieu Hoang
4c009e31e8 Merge branch 'master' of https://github.com/moses-smt/mosesdecoder into hieu 2014-01-20 17:08:02 +00:00
Rico Sennrich
5d2b4d8efc sparse feature weights can now be set in moses.ini; overrides weights in weight-file. 2014-01-20 15:54:17 +00:00
Hieu Hoang
ade7400fc7 minor error 2014-01-20 15:42:17 +00:00
Rico Sennrich
043444b293 copy weights of untuneable features from original config in mert 2014-01-20 10:06:42 +00:00