mirror of
https://github.com/Helsinki-NLP/OPUS-MT-train.git
synced 2024-10-26 21:19:02 +03:00
.. | ||
README.md |
opus-2020-01-16.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-01-16.zip
- test set translations: opus-2020-01-16.test.txt
- test set scores: opus-2020-01-16.eval.txt
Benchmarks
testset | BLEU | chr-F |
---|---|---|
newstest2012.en.ru | 23.7 | 0.436 |
newstest2013.en.ru | 19.4 | 0.413 |
newstest2015-enru.en.ru | 21.6 | 0.440 |
newstest2016-enru.en.ru | 21.0 | 0.432 |
newstest2017-enru.en.ru | 22.7 | 0.443 |
newstest2018-enru.en.ru | 19.2 | 0.413 |
newstest2019-enru.en.ru | 22.3 | 0.412 |
Tatoeba.en.ru | 46.9 | 0.656 |
opus-2020-02-11.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-02-11.zip
- test set translations: opus-2020-02-11.test.txt
- test set scores: opus-2020-02-11.eval.txt
Benchmarks
testset | BLEU | chr-F |
---|---|---|
newstest2012.en.ru | 31.1 | 0.581 |
newstest2013.en.ru | 23.5 | 0.513 |
newstest2015-enru.en.ru | 27.5 | 0.564 |
newstest2016-enru.en.ru | 26.4 | 0.548 |
newstest2017-enru.en.ru | 29.1 | 0.572 |
newstest2018-enru.en.ru | 25.4 | 0.554 |
newstest2019-enru.en.ru | 27.1 | 0.533 |
Tatoeba.en.ru | 48.4 | 0.669 |