| .. |
|
cleanup
|
lang specific cleanup scripts are now possible
|
2020-02-29 18:23:08 +02:00 |
|
evaluate
|
fixed a problem with langlabel files
|
2021-09-13 00:07:51 +03:00 |
|
filter
|
fixed multithreading issues with data recipe
|
2021-08-09 22:19:05 +03:00 |
|
bitext_filter.pl
|
fixing many bugs with tatoeba model recipes
|
2022-02-07 20:55:31 +02:00 |
|
detect_chinese_script.pl
|
fix chinese/korean/japanese language codes
|
2020-06-17 22:02:39 +03:00 |
|
fit-data-size.pl
|
released langpairs in tatoeba
|
2022-02-05 13:40:55 +02:00 |
|
fix_vocab.py
|
allas storage commands
|
2021-11-04 09:57:48 +02:00 |
|
large-context.pl
|
fixed multilingual tatoeba evaluation
|
2020-06-11 00:54:40 +03:00 |
|
normalize-scores.py
|
fix in reverse-data
|
2022-01-06 23:48:34 +02:00 |
|
pivot-bt.pl
|
added recipe for refreshing release info
|
2021-03-13 00:29:23 +02:00 |
|
postprocess-bpe.sh
|
removed dependence on moses tools in preprocessing script for released spm packages
|
2020-09-12 14:42:10 +03:00 |
|
postprocess-spm.sh
|
removed dependence on moses tools in preprocessing script for released spm packages
|
2020-09-12 14:42:10 +03:00 |
|
postprocess-txt.sh
|
internal sentence piece models in transformers
|
2020-09-12 16:16:01 +03:00 |
|
preprocess-bpe-multi-target.sh
|
removed dependence on moses tools in preprocessing script for released spm packages
|
2020-09-12 14:42:10 +03:00 |
|
preprocess-bpe.sh
|
removed dependence on moses tools in preprocessing script for released spm packages
|
2020-09-12 14:42:10 +03:00 |
|
preprocess-spm-multi-target.sh
|
added recipes for tatoeba models other than English
|
2021-05-04 08:49:16 +03:00 |
|
preprocess-spm.sh
|
added recipes for tatoeba models other than English
|
2021-05-04 08:49:16 +03:00 |
|
preprocess-txt-multi-target.sh
|
internal sentence piece models in transformers
|
2020-09-12 16:16:01 +03:00 |
|
preprocess-txt.sh
|
internal sentence piece models in transformers
|
2020-09-12 16:16:01 +03:00 |
|
readme2yaml.pl
|
fixed tatoeba group recipes
|
2021-02-16 20:36:00 +02:00 |
|
verify-wordalign.pl
|
fixed multilingual tatoeba evaluation
|
2020-06-11 00:54:40 +03:00 |
|
vocab2yaml.py
|
create valid yaml files from vocab
|
2021-10-05 17:43:46 +03:00 |
