google/sentencepiece
1
1
Fork 0
mirror of https://github.com/google/sentencepiece.git synced 2025-01-01 05:04:14 +03:00
Code Issues Packages Projects Releases Wiki Activity
7a5d14cfdf
sentencepiece/data
History
Taku Kudo 9ca65fa9b6 add optional NFKD support.
2022-05-29 11:43:42 +09:00
..
botchan.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00
extract_headers.pl use builtin protobuf-lite package in third_party 2019-01-08 11:40:08 +09:00
gen_spec_parser.pl Do not parse deprecated proto fileds 2019-01-08 19:25:11 +09:00
gen_unicode_scripts_code.pl Initialize repository 2017-03-07 19:43:50 +09:00
ids_denorm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
ids_norm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
nfkc_cf.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
nfkc.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
nfkd.tsv add optional NFKD support. 2022-05-29 11:43:42 +09:00
nmt_nfkc_cf.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
nmt_nfkc.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
Scripts.txt Initialize repository 2017-03-07 19:43:50 +09:00
wagahaiwa_nekodearu.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00