mirror of
https://github.com/Helsinki-NLP/OPUS-MT-train.git
synced 2024-09-11 20:27:19 +03:00
| .. | ||
| README.md | ||
opus-2019-12-05.zip
- dataset: opus
- model: transformer
- pre-processing: normalization + tokenization + BPE
- download: opus-2019-12-05.zip
- test set translations: opus-2019-12-05.test.txt
- test set scores: opus-2019-12-05.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newsdev2016-entr.tr.en | 23.3 | 0.504 |
| newstest2016-entr.tr.en | 20.8 | 0.489 |
| newstest2017-entr.tr.en | 21.0 | 0.493 |
| newstest2018-entr.tr.en | 21.6 | 0.497 |
| Tatoeba.tr.en | 41.3 | 0.633 |
opus-2020-01-16.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-01-16.zip
- test set translations: opus-2020-01-16.test.txt
- test set scores: opus-2020-01-16.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newsdev2016-entr.tr.en | 27.6 | 0.548 |
| newstest2016-entr.tr.en | 25.2 | 0.532 |
| newstest2017-entr.tr.en | 24.7 | 0.530 |
| newstest2018-entr.tr.en | 27.0 | 0.547 |
| Tatoeba.tr.en | 63.5 | 0.760 |