zle-eng

opus-2020-06-28.zip

• dataset: opus
• model: transformer
• source language(s): bel bel_Latn orv_Cyrl rue rus ukr
• target language(s): eng
• model: transformer
• pre-processing: normalization + SentencePiece (spm32k,spm32k)
• download: opus-2020-06-28.zip
• test set translations: opus-2020-06-28.test.txt
• test set scores: opus-2020-06-28.eval.txt

Benchmarks

testset	BLEU	chr-F
newstest2012-ruseng.rus.eng	29.5	0.565
newstest2013-ruseng.rus.eng	23.8	0.509
newstest2014-ruen-ruseng.rus.eng	26.1	0.547
newstest2015-enru-ruseng.rus.eng	25.0	0.523
newstest2016-enru-ruseng.rus.eng	24.5	0.521
newstest2017-enru-ruseng.rus.eng	27.1	0.540
newstest2018-enru-ruseng.rus.eng	23.8	0.520
newstest2019-ruen-ruseng.rus.eng	25.5	0.528
Tatoeba-test.bel-eng.bel.eng	35.6	0.541
Tatoeba-test.multi.eng	47.3	0.633
Tatoeba-test.orv-eng.orv.eng	4.9	0.213
Tatoeba-test.rue-eng.rue.eng	12.5	0.307
Tatoeba-test.rus-eng.rus.eng	49.9	0.654
Tatoeba-test.ukr-eng.ukr.eng	49.5	0.654

opus-2020-07-27.zip

• dataset: opus
• model: transformer
• source language(s): bel bel_Latn orv_Cyrl rue rus ukr
• target language(s): eng
• model: transformer
• pre-processing: normalization + SentencePiece (spm32k,spm32k)
• download: opus-2020-07-27.zip
• test set translations: opus-2020-07-27.test.txt
• test set scores: opus-2020-07-27.eval.txt

Benchmarks

testset	BLEU	chr-F
newstest2012-ruseng.rus.eng	29.4	0.564
newstest2013-ruseng.rus.eng	23.6	0.510
newstest2014-ruen-ruseng.rus.eng	26.2	0.548
newstest2015-enru-ruseng.rus.eng	25.1	0.525
newstest2016-enru-ruseng.rus.eng	24.6	0.524
newstest2017-enru-ruseng.rus.eng	27.5	0.545
newstest2018-enru-ruseng.rus.eng	24.1	0.523
newstest2019-ruen-ruseng.rus.eng	25.2	0.529
Tatoeba-test.bel-eng.bel.eng	35.4	0.543
Tatoeba-test.multi.eng	48.1	0.640
Tatoeba-test.orv-eng.orv.eng	7.5	0.207
Tatoeba-test.rue-eng.rue.eng	18.7	0.344
Tatoeba-test.rus-eng.rus.eng	50.6	0.660
Tatoeba-test.ukr-eng.ukr.eng	50.2	0.659

opus2m-2020-08-01.zip

• dataset: opus2m
• model: transformer
• source language(s): bel bel_Latn orv_Cyrl rue rus ukr
• target language(s): eng
• model: transformer
• pre-processing: normalization + SentencePiece (spm32k,spm32k)
• download: opus2m-2020-08-01.zip
• test set translations: opus2m-2020-08-01.test.txt
• test set scores: opus2m-2020-08-01.eval.txt

Benchmarks

testset	BLEU	chr-F
newstest2012-ruseng.rus.eng	31.1	0.579
newstest2013-ruseng.rus.eng	24.9	0.522
newstest2014-ruen-ruseng.rus.eng	27.9	0.563
newstest2015-enru-ruseng.rus.eng	26.8	0.541
newstest2016-enru-ruseng.rus.eng	25.8	0.535
newstest2017-enru-ruseng.rus.eng	29.1	0.561
newstest2018-enru-ruseng.rus.eng	25.4	0.537
newstest2019-ruen-ruseng.rus.eng	26.8	0.545
Tatoeba-test.bel-eng.bel.eng	38.3	0.569
Tatoeba-test.multi.eng	50.1	0.656
Tatoeba-test.orv-eng.orv.eng	6.9	0.217
Tatoeba-test.rue-eng.rue.eng	15.4	0.345
Tatoeba-test.rus-eng.rus.eng	52.5	0.674
Tatoeba-test.ukr-eng.ukr.eng	52.1	0.673

opus4m-2020-08-12.zip

• dataset: opus4m
• model: transformer
• source language(s): bel bel_Latn orv_Cyrl rue rus ukr
• target language(s): eng
• model: transformer
• pre-processing: normalization + SentencePiece (spm32k,spm32k)
• download: opus4m-2020-08-12.zip
• test set translations: opus4m-2020-08-12.test.txt
• test set scores: opus4m-2020-08-12.eval.txt

Benchmarks

testset	BLEU	chr-F
newstest2012-ruseng.rus.eng	32.0	0.585
newstest2013-ruseng.rus.eng	25.7	0.527
newstest2014-ruen-ruseng.rus.eng	28.8	0.570
newstest2015-enru-ruseng.rus.eng	27.5	0.547
newstest2016-enru-ruseng.rus.eng	26.8	0.543
newstest2017-enru-ruseng.rus.eng	30.3	0.568
newstest2018-enru-ruseng.rus.eng	26.3	0.542
newstest2019-ruen-ruseng.rus.eng	28.1	0.554
Tatoeba-test.bel-eng.bel.eng	38.7	0.573
Tatoeba-test.multi.eng	50.7	0.660
Tatoeba-test.orv-eng.orv.eng	7.7	0.227
Tatoeba-test.rue-eng.rue.eng	13.1	0.335
Tatoeba-test.rus-eng.rus.eng	53.4	0.682
Tatoeba-test.ukr-eng.ukr.eng	52.5	0.677