- dataset: opus
- model: transformer
- source language(s): bel bel_Latn orv_Cyrl rue rus ukr
- target language(s): eng
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opus-2020-06-28.zip
- test set translations: opus-2020-06-28.test.txt
- test set scores: opus-2020-06-28.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| newstest2012-ruseng.rus.eng | 29.5 | 0.565 |
| newstest2013-ruseng.rus.eng | 23.8 | 0.509 |
| newstest2014-ruen-ruseng.rus.eng | 26.1 | 0.547 |
| newstest2015-enru-ruseng.rus.eng | 25.0 | 0.523 |
| newstest2016-enru-ruseng.rus.eng | 24.5 | 0.521 |
| newstest2017-enru-ruseng.rus.eng | 27.1 | 0.540 |
| newstest2018-enru-ruseng.rus.eng | 23.8 | 0.520 |
| newstest2019-ruen-ruseng.rus.eng | 25.5 | 0.528 |
| Tatoeba-test.bel-eng.bel.eng | 35.6 | 0.541 |
| Tatoeba-test.multi.eng | 47.3 | 0.633 |
| Tatoeba-test.orv-eng.orv.eng | 4.9 | 0.213 |
| Tatoeba-test.rue-eng.rue.eng | 12.5 | 0.307 |
| Tatoeba-test.rus-eng.rus.eng | 49.9 | 0.654 |
| Tatoeba-test.ukr-eng.ukr.eng | 49.5 | 0.654 |
- dataset: opus
- model: transformer
- source language(s): bel bel_Latn orv_Cyrl rue rus ukr
- target language(s): eng
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opus-2020-07-27.zip
- test set translations: opus-2020-07-27.test.txt
- test set scores: opus-2020-07-27.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| newstest2012-ruseng.rus.eng | 29.4 | 0.564 |
| newstest2013-ruseng.rus.eng | 23.6 | 0.510 |
| newstest2014-ruen-ruseng.rus.eng | 26.2 | 0.548 |
| newstest2015-enru-ruseng.rus.eng | 25.1 | 0.525 |
| newstest2016-enru-ruseng.rus.eng | 24.6 | 0.524 |
| newstest2017-enru-ruseng.rus.eng | 27.5 | 0.545 |
| newstest2018-enru-ruseng.rus.eng | 24.1 | 0.523 |
| newstest2019-ruen-ruseng.rus.eng | 25.2 | 0.529 |
| Tatoeba-test.bel-eng.bel.eng | 35.4 | 0.543 |
| Tatoeba-test.multi.eng | 48.1 | 0.640 |
| Tatoeba-test.orv-eng.orv.eng | 7.5 | 0.207 |
| Tatoeba-test.rue-eng.rue.eng | 18.7 | 0.344 |
| Tatoeba-test.rus-eng.rus.eng | 50.6 | 0.660 |
| Tatoeba-test.ukr-eng.ukr.eng | 50.2 | 0.659 |
- dataset: opus2m
- model: transformer
- source language(s): bel bel_Latn orv_Cyrl rue rus ukr
- target language(s): eng
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opus2m-2020-08-01.zip
- test set translations: opus2m-2020-08-01.test.txt
- test set scores: opus2m-2020-08-01.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| newstest2012-ruseng.rus.eng | 31.1 | 0.579 |
| newstest2013-ruseng.rus.eng | 24.9 | 0.522 |
| newstest2014-ruen-ruseng.rus.eng | 27.9 | 0.563 |
| newstest2015-enru-ruseng.rus.eng | 26.8 | 0.541 |
| newstest2016-enru-ruseng.rus.eng | 25.8 | 0.535 |
| newstest2017-enru-ruseng.rus.eng | 29.1 | 0.561 |
| newstest2018-enru-ruseng.rus.eng | 25.4 | 0.537 |
| newstest2019-ruen-ruseng.rus.eng | 26.8 | 0.545 |
| Tatoeba-test.bel-eng.bel.eng | 38.3 | 0.569 |
| Tatoeba-test.multi.eng | 50.1 | 0.656 |
| Tatoeba-test.orv-eng.orv.eng | 6.9 | 0.217 |
| Tatoeba-test.rue-eng.rue.eng | 15.4 | 0.345 |
| Tatoeba-test.rus-eng.rus.eng | 52.5 | 0.674 |
| Tatoeba-test.ukr-eng.ukr.eng | 52.1 | 0.673 |
- dataset: opus4m
- model: transformer
- source language(s): bel bel_Latn orv_Cyrl rue rus ukr
- target language(s): eng
- model: transformer
- pre-processing: normalization + SentencePiece (spm32k,spm32k)
- download: opus4m-2020-08-12.zip
- test set translations: opus4m-2020-08-12.test.txt
- test set scores: opus4m-2020-08-12.eval.txt
| testset | BLEU | chr-F |
|---|---|---|
| newstest2012-ruseng.rus.eng | 32.0 | 0.585 |
| newstest2013-ruseng.rus.eng | 25.7 | 0.527 |
| newstest2014-ruen-ruseng.rus.eng | 28.8 | 0.570 |
| newstest2015-enru-ruseng.rus.eng | 27.5 | 0.547 |
| newstest2016-enru-ruseng.rus.eng | 26.8 | 0.543 |
| newstest2017-enru-ruseng.rus.eng | 30.3 | 0.568 |
| newstest2018-enru-ruseng.rus.eng | 26.3 | 0.542 |
| newstest2019-ruen-ruseng.rus.eng | 28.1 | 0.554 |
| Tatoeba-test.bel-eng.bel.eng | 38.7 | 0.573 |
| Tatoeba-test.multi.eng | 50.7 | 0.660 |
| Tatoeba-test.orv-eng.orv.eng | 7.7 | 0.227 |
| Tatoeba-test.rue-eng.rue.eng | 13.1 | 0.335 |
| Tatoeba-test.rus-eng.rus.eng | 53.4 | 0.682 |
| Tatoeba-test.ukr-eng.ukr.eng | 52.5 | 0.677 |