Rico Sennrich 0607b5443f byte-level BPE. Still not fully tested, fails some unit tests with glossaries.		2024-07-24 14:12:50 +02:00
..
data	add some more umlauts to tests to check behavior in different locales	2020-02-21 17:39:42 +01:00
__init__.py	modify files for packaging; thanks to universome	2018-05-16 14:35:23 +01:00
test_bpe.py	modify files for packaging; thanks to universome	2018-05-16 14:35:23 +01:00
test_glossaries.py	byte-level BPE. Still not fully tested, fails some unit tests with glossaries.	2024-07-24 14:12:50 +02:00