moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-07-14 23:00:29 +03:00
Code Issues Packages Projects Releases Wiki Activity

Fix non-ASCII lowercasing

Browse Source
This commit is contained in:
Joel Barry 2019-02-27 10:17:29 -05:00
parent 49b388ac79
commit fdb7384d3d
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
scripts/generic/multi-bleu-detok.perl
View File

@ -14,6 +14,9 @@
use warnings;
use strict;
binmode(STDIN, ":utf8");
use open ':encoding(UTF-8)';
my $lowercase = 0;
if ($ARGV[0] eq "-lc") {
$lowercase = 1;