mirror of
https://github.com/Helsinki-NLP/OPUS-MT-train.git
synced 2024-09-11 20:27:19 +03:00
| .. | ||
| README.md | ||
opus-2019-12-05.zip
- dataset: opus
- model: transformer
- pre-processing: normalization + tokenization + BPE
- download: opus-2019-12-05.zip
- test set translations: opus-2019-12-05.test.txt
- test set scores: opus-2019-12-05.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newsdiscussdev2015-enfr.fr.en | 30.8 | 0.564 |
| newsdiscusstest2015-enfr.fr.en | 35.4 | 0.595 |
| newssyscomb2009.fr.en | 29.0 | 0.555 |
| news-test2008.fr.en | 24.9 | 0.525 |
| newstest2009.fr.en | 28.6 | 0.550 |
| newstest2010.fr.en | 30.4 | 0.571 |
| newstest2011.fr.en | 31.7 | 0.575 |
| newstest2012.fr.en | 31.8 | 0.570 |
| newstest2013.fr.en | 32.6 | 0.570 |
| newstest2014-fren.fr.en | 35.4 | 0.607 |
| Tatoeba.fr.en | 60.9 | 0.726 |
opus-2020-02-26.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-02-26.zip
- test set translations: opus-2020-02-26.test.txt
- test set scores: opus-2020-02-26.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newsdiscussdev2015-enfr.fr.en | 33.1 | 0.580 |
| newsdiscusstest2015-enfr.fr.en | 38.7 | 0.614 |
| newssyscomb2009.fr.en | 30.3 | 0.569 |
| news-test2008.fr.en | 26.2 | 0.542 |
| newstest2009.fr.en | 30.2 | 0.570 |
| newstest2010.fr.en | 32.2 | 0.590 |
| newstest2011.fr.en | 33.0 | 0.597 |
| newstest2012.fr.en | 32.8 | 0.591 |
| newstest2013.fr.en | 33.9 | 0.591 |
| newstest2014-fren.fr.en | 37.8 | 0.633 |
| Tatoeba.fr.en | 57.5 | 0.720 |