mirror of
https://github.com/Helsinki-NLP/OPUS-MT-train.git
synced 2024-12-02 20:48:08 +03:00
.. | ||
README.md |
opus-2019-12-04.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2019-12-04.zip
- test set translations: opus-2019-12-04.test.txt
- test set scores: opus-2019-12-04.eval.txt
Benchmarks
testset | BLEU | chr-F |
---|---|---|
newssyscomb2009.en.de | 22.2 | 0.529 |
news-test2008.en.de | 22.6 | 0.520 |
newstest2009.en.de | 21.5 | 0.522 |
newstest2010.en.de | 23.9 | 0.535 |
newstest2011.en.de | 21.6 | 0.516 |
newstest2012.en.de | 22.1 | 0.516 |
newstest2013.en.de | 25.8 | 0.543 |
newstest2015-ende.en.de | 29.9 | 0.581 |
newstest2016-ende.en.de | 35.7 | 0.623 |
newstest2017-ende.en.de | 28.5 | 0.573 |
newstest2018-ende.en.de | 42.8 | 0.669 |
newstest2019-ende.en.de | 39.2 | 0.638 |
Tatoeba.en.de | 44.2 | 0.637 |
opus-2019-12-18.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2019-12-18.zip
- test set translations: opus-2019-12-18.test.txt
- test set scores: opus-2019-12-18.eval.txt
Benchmarks
testset | BLEU | chr-F |
---|---|---|
newssyscomb2009.en.de | 23.1 | 0.535 |
news-test2008.en.de | 23.5 | 0.529 |
newstest2009.en.de | 22.2 | 0.529 |
newstest2010.en.de | 24.9 | 0.543 |
newstest2011.en.de | 22.3 | 0.522 |
newstest2012.en.de | 23.0 | 0.523 |
newstest2013.en.de | 26.6 | 0.550 |
newstest2015-ende.en.de | 31.5 | 0.593 |
newstest2016-ende.en.de | 36.8 | 0.633 |
newstest2017-ende.en.de | 29.9 | 0.583 |
newstest2018-ende.en.de | 44.8 | 0.685 |
newstest2019-ende.en.de | 41.6 | 0.655 |
Tatoeba.en.de | 46.8 | 0.655 |
opus-2020-02-26.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-02-26.zip
- test set translations: opus-2020-02-26.test.txt
- test set scores: opus-2020-02-26.eval.txt
Benchmarks
testset | BLEU | chr-F |
---|---|---|
newssyscomb2009.en.de | 23.5 | 0.540 |
news-test2008.en.de | 23.5 | 0.529 |
newstest2009.en.de | 22.3 | 0.530 |
newstest2010.en.de | 24.9 | 0.544 |
newstest2011.en.de | 22.5 | 0.524 |
newstest2012.en.de | 23.0 | 0.525 |
newstest2013.en.de | 26.9 | 0.553 |
newstest2015-ende.en.de | 31.1 | 0.594 |
newstest2016-ende.en.de | 37.0 | 0.636 |
newstest2017-ende.en.de | 29.9 | 0.586 |
newstest2018-ende.en.de | 45.2 | 0.690 |
newstest2019-ende.en.de | 40.9 | 0.654 |
Tatoeba.en.de | 47.3 | 0.664 |