Jörg Tiedemann 666b2b8462 internal sentence piece models in transformers		2020-09-12 16:16:01 +03:00
..
cleanup	lang specific cleanup scripts are now possible	2020-02-29 18:23:08 +02:00
filter	tatoeba challenge model scripts updated	2020-06-06 20:49:54 +03:00
detect_chinese_script.pl	fix chinese/korean/japanese language codes	2020-06-17 22:02:39 +03:00
fit-data-size.pl	fit-data-size fixed	2020-06-08 14:14:55 +03:00
large-context.pl	fixed multilingual tatoeba evaluation	2020-06-11 00:54:40 +03:00
postprocess-bpe.sh	removed dependence on moses tools in preprocessing script for released spm packages	2020-09-12 14:42:10 +03:00
postprocess-spm.sh	removed dependence on moses tools in preprocessing script for released spm packages	2020-09-12 14:42:10 +03:00
postprocess-txt.sh	internal sentence piece models in transformers	2020-09-12 16:16:01 +03:00
preprocess-bpe-multi-target.sh	removed dependence on moses tools in preprocessing script for released spm packages	2020-09-12 14:42:10 +03:00
preprocess-bpe.sh	removed dependence on moses tools in preprocessing script for released spm packages	2020-09-12 14:42:10 +03:00
preprocess-spm-multi-target.sh	internal sentence piece models in transformers	2020-09-12 16:16:01 +03:00
preprocess-spm.sh	internal sentence piece models in transformers	2020-09-12 16:16:01 +03:00
preprocess-txt-multi-target.sh	internal sentence piece models in transformers	2020-09-12 16:16:01 +03:00
preprocess-txt.sh	internal sentence piece models in transformers	2020-09-12 16:16:01 +03:00
verify-wordalign.pl	fixed multilingual tatoeba evaluation	2020-06-11 00:54:40 +03:00