moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-08-16 23:10:31 +03:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #214 from JetRunner/patch-1

Browse Source 
Fix the incorrect processing considering fullwidth number character
This commit is contained in:
Hieu Hoang 2019-10-18 19:54:46 -07:00 committed by GitHub
commit 286188b82a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
scripts/tokenizer/replace-unicode-punctuation.perl
View File

@ -29,7 +29,7 @@ while(<STDIN>) {
s/！/\!/g;
s/（/\(/g;
s/；/;/g;
s/１/"/g;
s/１/1/g;
s/」/"/g;
s/「/"/g;
s/０/0/g;