mirror of
https://github.com/Helsinki-NLP/OPUS-MT-train.git
synced 2024-09-11 20:27:19 +03:00
| .. | ||
| README.md | ||
opus-2019-12-04.zip
- dataset: opus
- model: transformer
- pre-processing: normalization + tokenization + BPE
- download: opus-2019-12-04.zip
- test set translations: opus-2019-12-04.test.txt
- test set scores: opus-2019-12-04.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newssyscomb2009.de.en | 25.6 | 0.525 |
| news-test2008.de.en | 24.2 | 0.515 |
| newstest2009.de.en | 23.7 | 0.513 |
| newstest2010.de.en | 26.8 | 0.548 |
| newstest2011.de.en | 24.9 | 0.522 |
| newstest2012.de.en | 26.3 | 0.529 |
| newstest2013.de.en | 28.8 | 0.546 |
| newstest2014-deen.de.en | 28.3 | 0.548 |
| newstest2015-ende.de.en | 28.9 | 0.549 |
| newstest2016-ende.de.en | 33.9 | 0.595 |
| newstest2017-ende.de.en | 29.4 | 0.558 |
| newstest2018-ende.de.en | 36.2 | 0.603 |
| newstest2019-deen.de.en | 33.8 | 0.585 |
| Tatoeba.de.en | 41.6 | 0.626 |