mosesdecoder/scripts
Louis MARTIN 53da5f4dbe Fix multi-bleu.perl bug when file does not end with newline
When reading hypothesis and reference files, multi-bleu.perl uses the
chop function to remove the trailing newline character.
If one of these files happens to not end with a newline, then chop will
remove the last character of the last line (instead of the newline).
This causes the BLEU score to be slightly off from its theoretical
value.
Using the safest chomp function solves this problem, i.e. it only
removes newlines when present.
2018-07-03 04:06:09 -06:00
..
analysis Added a simple support for the factored systems. 2015-08-27 15:15:32 +02:00
docker removed redundant subdirectory in path 2017-04-12 10:15:18 +08:00
ems fix syntax error in regular expression 2018-06-22 18:16:11 +01:00
fuzzy-match Add license notices to scripts. 2015-05-29 18:30:26 +07:00
generic Fix multi-bleu.perl bug when file does not end with newline 2018-07-03 04:06:09 -06:00
nbest-rescore README formatting fix 2016-03-14 02:23:06 -04:00
OSM removed invalid '--reduced' from cp command in OSM-Train.perl 2016-03-23 19:31:04 -04:00
other Add license notices to scripts. 2015-05-29 18:30:26 +07:00
recaser ignore words where there is nothing to case 2017-04-07 17:28:13 +02:00
regression-testing Add license notices to scripts. 2015-05-29 18:30:26 +07:00
server Add license notices to scripts. 2015-05-29 18:30:26 +07:00
share/nonbreaking_prefixes Create a Cantonese version, distinct from Mandarin. 2017-01-05 12:53:21 -06:00
tests dos2unix everything 2015-08-23 19:00:19 +04:00
tokenizer Contributing MosesTokenizer from NLTK to Moses 2018-04-11 00:27:37 +08:00
training The .gz extension should be also added for 'On Disk' and 'Probing' Phrase tables. 2017-11-28 10:29:58 +01:00
Transliteration output debugging messages to stderr not stdout 2016-09-29 07:16:57 -04:00
Jamfile Fixed interaction of --install-scripts and --git 2012-08-09 11:04:24 -04:00
README fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00

2006-07-29

This directory should contain all multi-purpose scripts for:

- training    ... training moses (including BLEU evaluation needed for MERT)
- analysis    ... analyzing MT output (for human analysis)
- generic     ... script for handling generic issues (parallelization)
- lib         ... perl modules used by various scripts


The Jamfile then takes care of proper 'release' from your git directory to
the shared directories.

The released scripts should remain in the *same directory structure*.