google/sentencepiece
1
1
Fork 0
mirror of https://github.com/google/sentencepiece.git synced 2024-09-11 10:55:42 +03:00
Code Issues Packages Projects Releases Wiki Activity
0ba506938c
sentencepiece/python/test
History
Taku Kudo 41c4b7f080 returns unicode characetr offsets in normalize method
2024-01-22 07:19:04 +00:00
..
__init__.py Added Python wrapper 2017-08-29 00:26:23 +09:00
botchan.txt Added SentencePieceTrainer class 2018-02-28 19:54:11 +09:00
sentencepiece_test.py returns unicode characetr offsets in normalize method 2024-01-22 07:19:04 +00:00
test_ja_model.model Add tests using Japanese model, in order to check Unicode encoding. 2017-10-13 09:49:46 +09:00
test_model.model Added Python wrapper 2017-08-29 00:26:23 +09:00