mirror of
https://github.com/Helsinki-NLP/OPUS-MT-train.git
synced 2024-09-11 20:27:19 +03:00
| .. | ||
| README.md | ||
opus-2020-01-16.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-01-16.zip
- test set translations: opus-2020-01-16.test.txt
- test set scores: opus-2020-01-16.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newstest2012.en.ru | 23.7 | 0.436 |
| newstest2013.en.ru | 19.4 | 0.413 |
| newstest2015-enru.en.ru | 21.6 | 0.440 |
| newstest2016-enru.en.ru | 21.0 | 0.432 |
| newstest2017-enru.en.ru | 22.7 | 0.443 |
| newstest2018-enru.en.ru | 19.2 | 0.413 |
| newstest2019-enru.en.ru | 22.3 | 0.412 |
| Tatoeba.en.ru | 46.9 | 0.656 |
opus-2020-02-11.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-02-11.zip
- test set translations: opus-2020-02-11.test.txt
- test set scores: opus-2020-02-11.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newstest2012.en.ru | 31.1 | 0.581 |
| newstest2013.en.ru | 23.5 | 0.513 |
| newstest2015-enru.en.ru | 27.5 | 0.564 |
| newstest2016-enru.en.ru | 26.4 | 0.548 |
| newstest2017-enru.en.ru | 29.1 | 0.572 |
| newstest2018-enru.en.ru | 25.4 | 0.554 |
| newstest2019-enru.en.ru | 27.1 | 0.533 |
| Tatoeba.en.ru | 48.4 | 0.669 |