google/sentencepiece
1
1
Fork 0
mirror of https://github.com/google/sentencepiece.git synced 2024-08-15 22:00:43 +03:00
Code Issues Packages Projects Releases Wiki Activity
revert-957-dependabot/github_actions/github-actions-bcafe21e81
sentencepiece/data
History
Taku Kudo 9ca65fa9b6 add optional NFKD support.
2022-05-29 11:43:42 +09:00
..
botchan.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00
extract_headers.pl use builtin protobuf-lite package in third_party 2019-01-08 11:40:08 +09:00
gen_spec_parser.pl Do not parse deprecated proto fileds 2019-01-08 19:25:11 +09:00
gen_unicode_scripts_code.pl Initialize repository 2017-03-07 19:43:50 +09:00
ids_denorm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
ids_norm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
nfkc_cf.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
nfkc.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
nfkd.tsv add optional NFKD support. 2022-05-29 11:43:42 +09:00
nmt_nfkc_cf.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
nmt_nfkc.tsv updated *.tsv file. 2021-06-18 01:06:29 +09:00
Scripts.txt Initialize repository 2017-03-07 19:43:50 +09:00
wagahaiwa_nekodearu.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00