mirror of
https://github.com/Helsinki-NLP/OPUS-MT-train.git
synced 2024-09-11 20:27:19 +03:00
.. | ||
README.md |
opus-2019-12-04.zip
- dataset: opus
- model: transformer
- pre-processing: normalization + tokenization + BPE
- download: opus-2019-12-04.zip
- test set translations: opus-2019-12-04.test.txt
- test set scores: opus-2019-12-04.eval.txt
Benchmarks
testset | BLEU | chr-F |
---|---|---|
newsdiscussdev2015-enfr.en.fr | 23.7 | 0.540 |
newsdiscusstest2015-enfr.en.fr | 27.4 | 0.581 |
newssyscomb2009.en.fr | 22.1 | 0.523 |
news-test2008.en.fr | 20.1 | 0.495 |
newstest2009.en.fr | 22.0 | 0.522 |
newstest2010.en.fr | 23.3 | 0.534 |
newstest2011.en.fr | 24.4 | 0.542 |
newstest2012.en.fr | 22.8 | 0.521 |
newstest2013.en.fr | 24.0 | 0.525 |
Tatoeba.en.fr | 56.7 | 0.682 |
opus-2020-02-26.zip
- dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download: opus-2020-02-26.zip
- test set translations: opus-2020-02-26.test.txt
- test set scores: opus-2020-02-26.eval.txt
Benchmarks
testset | BLEU | chr-F |
---|---|---|
newsdiscussdev2015-enfr.en.fr | 33.8 | 0.602 |
newsdiscusstest2015-enfr.en.fr | 40.0 | 0.643 |
newssyscomb2009.en.fr | 29.8 | 0.584 |
news-test2008.en.fr | 27.5 | 0.554 |
newstest2009.en.fr | 29.4 | 0.577 |
newstest2010.en.fr | 32.7 | 0.596 |
newstest2011.en.fr | 34.3 | 0.611 |
newstest2012.en.fr | 31.8 | 0.592 |
newstest2013.en.fr | 33.2 | 0.589 |
Tatoeba.en.fr | 50.5 | 0.672 |