moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-26 13:23:25 +03:00
Code Issues Packages Projects Releases Wiki Activity
a693c83161
mosesdecoder/scripts/analysis
History
Jeroen Vermeulen a25193cc5d Fix a lot of lint, mostly trailing whitespace. 
This is lint reported by the new lint-checking functionality in beautify.py.
(We can change to a different lint checker if we have a better one, but it
would probably still flag these same problems.)

Lint checking can help a lot, but only if we get the lint under control.
2015-05-17 20:04:04 +07:00
..
perllib Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
smtgui Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
bootstrap-hypothesis-difference-significance.pl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
extract-target-trees.py Fix more Python lint. 2015-05-16 18:03:54 +07:00
nontranslated_words.pl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
oov.pl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
README fix start weights in experiment.perl, add hypothesis queue for picking hope and fear translations, add variations to 1slack formulation 2012-06-01 01:49:42 +01:00
sentence-by-sentence.pl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
sg2dot.perl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
show-phrases-used.pl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
suspicious_tokenization.pl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00
weight-scan-summarize.sh Ondrej's little tools to examine weight settings 2011-07-08 00:11:10 +00:00
weight-scan.pl Fix a lot of lint, mostly trailing whitespace. 2015-05-17 20:04:04 +07:00

README 

Put any scripts useful for human analysis of MT output here.

sentence-by-sentence.pl [EVH]: show comparison of sentences in reference translation(s)/system output(s)/(truth) in colorful format
-- show all sentences given, with non-matching words in the system output marked, BLEU scores given by sentence, and matching n-grams shown in a table
-- requires all input files be utf8-encoded (you can convert a file with `cat FILE | perl -n -e 'binmode(STDOUT, ":utf8"); print;' > FILE.utf8`)

show-phrases-used.pl [EVH]: draw colorful diagram of which source phrases map to which target phrases
-- requires the Perl GD module, which in turn requires that gd be installed and in LD_LIBRARY_PATH
-- show average length of source phrases used for each sentence and overall
-- command-line options -r for reference and -s for source; lone filenames are taken to be system outputs