sentencepiece/data
2021-02-23 20:47:25 +05:30
..
botchan.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00
extract_headers.pl use builtin protobuf-lite package in third_party 2019-01-08 11:40:08 +09:00
gen_spec_parser.pl Do not parse deprecated proto fileds 2019-01-08 19:25:11 +09:00
gen_unicode_scripts_code.pl Initialize repository 2017-03-07 19:43:50 +09:00
ids_denorm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
ids_norm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
nfkc_cf.tsv pushed new nfkc_cf.tsv 2018-10-29 01:11:45 +09:00
nfkc.tsv Uses NMT_NFKC rule by default. 2018-06-10 01:15:34 +09:00
nmt_nfkc_cf.tsv Removed codes where Zero Width Joiner replaced with whitespace. 2021-02-23 20:47:25 +05:30
nmt_nfkc.tsv Removed codes where Zero Width Joiner replaced with whitespace. 2021-02-23 20:47:25 +05:30
Scripts.txt Initialize repository 2017-03-07 19:43:50 +09:00
wagahaiwa_nekodearu.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00