2020-01-10 17:45:42 +03:00
|
|
|
# opus-2019-12-18.zip
|
|
|
|
|
|
|
|
|
|
* dataset: opus
|
|
|
|
|
* model: transformer-align
|
|
|
|
|
* pre-processing: normalization + SentencePiece
|
|
|
|
|
* download: [opus-2019-12-18.zip](https://object.pouta.csc.fi/OPUS-MT-models/chk-en/opus-2019-12-18.zip)
|
|
|
|
|
* test set translations: [opus-2019-12-18.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/chk-en/opus-2019-12-18.test.txt)
|
|
|
|
|
* test set scores: [opus-2019-12-18.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/chk-en/opus-2019-12-18.eval.txt)
|
|
|
|
|
|
|
|
|
|
## Benchmarks
|
|
|
|
|
|
|
|
|
|
| testset | BLEU | chr-F |
|
|
|
|
|
|-----------------------|-------|-------|
|
|
|
|
|
| JW300.chk.en | 31.2 | 0.465 |
|
|
|
|
|
|
2020-05-29 14:43:36 +03:00
|
|
|
# opus+bt-2020-05-23.zip
|
|
|
|
|
|
|
|
|
|
* dataset: opus+bt
|
|
|
|
|
* model: transformer-align
|
|
|
|
|
* source language(s): chk
|
|
|
|
|
* target language(s): en
|
|
|
|
|
* model: transformer-align
|
|
|
|
|
* pre-processing: normalization + SentencePiece (spm4k,spm4k)
|
|
|
|
|
* download: [opus+bt-2020-05-23.zip](https://object.pouta.csc.fi/OPUS-MT-models/chk-en/opus+bt-2020-05-23.zip)
|
|
|
|
|
* test set translations: [opus+bt-2020-05-23.test.txt](https://object.pouta.csc.fi/OPUS-MT-models/chk-en/opus+bt-2020-05-23.test.txt)
|
|
|
|
|
* test set scores: [opus+bt-2020-05-23.eval.txt](https://object.pouta.csc.fi/OPUS-MT-models/chk-en/opus+bt-2020-05-23.eval.txt)
|
|
|
|
|
|
|
|
|
|
## Training data: opus+bt
|
|
|
|
|
|
|
|
|
|
* chk-en:
|
|
|
|
|
* chk-en: total size = 0
|
|
|
|
|
* unused dev/test data is added to training data
|
|
|
|
|
* total size (opus+bt): 174907
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Validation data
|
|
|
|
|
|
|
|
|
|
* chk-en: JW300, 179979
|
|
|
|
|
* total size of shuffled dev data: 179979
|
|
|
|
|
|
|
|
|
|
* devset = top 2500 lines of JW300.src.shuffled!
|
|
|
|
|
* testset = next 2500 lines of JW300.src.shuffled!
|
|
|
|
|
* remaining lines are added to traindata
|
|
|
|
|
|
|
|
|
|
## Benchmarks
|
|
|
|
|
|
|
|
|
|
| testset | BLEU | chr-F |
|
|
|
|
|
|-----------------------|-------|-------|
|
|
|
|
|
| JW300.chk.en | 30.7 | 0.466 |
|
|
|
|
|
|
