Commit Graph

7 Commits

Author SHA1 Message Date
Rico Sennrich
65db9c5407 create symlink in old script location (with deprecation warning) 2018-05-16 14:47:23 +01:00
Rico Sennrich
2a4a44b5c0 move files to package structure; add setup.py 2018-05-16 11:44:24 +01:00
Rico Sennrich
662efd1b9d don't strip UTF-8 whitespace 2018-05-01 19:14:13 +01:00
Rico Sennrich
aa1bd9fe51 get_vocabulary: don't crash on double whitespace or empty line 2018-03-26 19:04:10 +01:00
Rico Sennrich
0541c3ef0f make get_vocab consistent with new whitespace-only splitting in apply_bpe
(thanks to Ondrej Bojar)
2018-03-14 21:15:47 +00:00
roland
d796a78a17 using python3 print function 2016-11-08 10:00:31 +01:00
Rico Sennrich
83b1847647 initial commit 2015-09-01 11:48:49 +01:00