moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-27 05:55:02 +03:00
Code Issues Packages Projects Releases Wiki Activity
00b21b4f53
mosesdecoder/scripts/share
History
Jeremy Gwinnup a5fb4d1550 Fixed bug in tokenizer.perl where comma separated lists of single 
characters aren't handled correctly

input> A,B,C,D,E,F

yielded> A, B,C , D,E , F

now yields> A, B, C, D, E, F

Updated Russian nonbreaking prefixes list with capital letters
2013-08-16 14:39:50 -04:00
..
nonbreaking_prefixes Fixed bug in tokenizer.perl where comma separated lists of single 2013-08-16 14:39:50 -04:00