sentencepiece/data
2024-02-25 15:47:08 +00:00
..
botchan.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00
extract_headers.pl use builtin protobuf-lite package in third_party 2019-01-08 11:40:08 +09:00
gen_spec_parser.pl Do not parse deprecated proto fileds 2019-01-08 19:25:11 +09:00
gen_unicode_scripts_code.pl Initialize repository 2017-03-07 19:43:50 +09:00
ids_denorm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
ids_norm.tsv Initial release of 0.19. Merged internal sentencepiece. 2020-05-08 01:06:50 +09:00
nfc_cf.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nfc.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nfd_cf.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nfd.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nfkc_cf.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nfkc.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nfkd_cf.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nfkd.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nmt_nfkc_cf.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
nmt_nfkc.tsv add nfc, nfd normalization tsv files 2024-02-25 15:47:08 +00:00
Scripts.txt Initialize repository 2017-03-07 19:43:50 +09:00
wagahaiwa_nekodearu.txt Remove empty lines from example data 2018-06-20 17:23:18 +09:00