Skip to content

Latest commit

 

History

History
180 lines (156 loc) · 7.96 KB

README.md

File metadata and controls

180 lines (156 loc) · 7.96 KB

opus-2020-06-28.zip

  • dataset: opus
  • model: transformer
  • source language(s): kdx kin lin lug nya run sna swh toi_Latn tso umb xho zul
  • target language(s): eng
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • download: opus-2020-06-28.zip
  • test set translations: opus-2020-06-28.test.txt
  • test set scores: opus-2020-06-28.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.kdx-eng.kdx.eng 11.9 0.285
Tatoeba-test.kin-eng.kin.eng 22.3 0.422
Tatoeba-test.lin-eng.lin.eng 10.8 0.238
Tatoeba-test.lug-eng.lug.eng 3.6 0.135
Tatoeba-test.multi.eng 25.5 0.424
Tatoeba-test.nya-eng.nya.eng 41.5 0.528
Tatoeba-test.run-eng.run.eng 24.7 0.419
Tatoeba-test.sna-eng.sna.eng 24.3 0.417
Tatoeba-test.swa-eng.swa.eng 4.9 0.203
Tatoeba-test.toi-eng.toi.eng 5.5 0.160
Tatoeba-test.tso-eng.tso.eng 100.0 1.000
Tatoeba-test.umb-eng.umb.eng 7.1 0.209
Tatoeba-test.xho-eng.xho.eng 35.4 0.516
Tatoeba-test.zul-eng.zul.eng 52.9 0.659

opus-2020-07-04.zip

Benchmarks

testset BLEU chr-F
Tatoeba-test.kdx-eng.kdx.eng 4.2 0.198
Tatoeba-test.kin-eng.kin.eng 24.0 0.417
Tatoeba-test.lin-eng.lin.eng 8.1 0.254
Tatoeba-test.lug-eng.lug.eng 3.4 0.141
Tatoeba-test.multi.eng 26.3 0.433
Tatoeba-test.nya-eng.nya.eng 29.1 0.485
Tatoeba-test.run-eng.run.eng 26.4 0.433
Tatoeba-test.sna-eng.sna.eng 24.4 0.400
Tatoeba-test.toi-eng.toi.eng 5.8 0.142
Tatoeba-test.tso-eng.tso.eng 79.7 0.852
Tatoeba-test.umb-eng.umb.eng 4.8 0.215
Tatoeba-test.xho-eng.xho.eng 35.4 0.523
Tatoeba-test.zul-eng.zul.eng 45.6 0.577

opus-2020-07-14.zip

Benchmarks

testset BLEU chr-F
Tatoeba-test.kin-eng.kin.eng 29.1 0.472
Tatoeba-test.lin-eng.lin.eng 5.7 0.239
Tatoeba-test.lug-eng.lug.eng 8.2 0.277
Tatoeba-test.multi.eng 22.2 0.386
Tatoeba-test.nya-eng.nya.eng 35.0 0.516
Tatoeba-test.run-eng.run.eng 26.0 0.425
Tatoeba-test.sna-eng.sna.eng 15.9 0.374
Tatoeba-test.toi-eng.toi.eng 5.0 0.094
Tatoeba-test.tso-eng.tso.eng 100.0 1.000
Tatoeba-test.umb-eng.umb.eng 5.4 0.199
Tatoeba-test.xho-eng.xho.eng 37.1 0.547
Tatoeba-test.zul-eng.zul.eng 47.1 0.606

opus-2020-07-19.zip

Benchmarks

testset BLEU chr-F
Tatoeba-test.kin-eng.kin.eng 37.7 0.550
Tatoeba-test.lin-eng.lin.eng 8.1 0.244
Tatoeba-test.lug-eng.lug.eng 8.2 0.282
Tatoeba-test.multi.eng 22.3 0.386
Tatoeba-test.nya-eng.nya.eng 40.1 0.529
Tatoeba-test.run-eng.run.eng 25.9 0.423
Tatoeba-test.sna-eng.sna.eng 19.6 0.395
Tatoeba-test.swa-eng.swa.eng 4.6 0.191
Tatoeba-test.toi-eng.toi.eng 14.5 0.347
Tatoeba-test.tso-eng.tso.eng 100.0 1.000
Tatoeba-test.umb-eng.umb.eng 5.4 0.201
Tatoeba-test.xho-eng.xho.eng 37.2 0.553
Tatoeba-test.zul-eng.zul.eng 42.7 0.573

opus-2020-07-26.zip

Benchmarks

testset BLEU chr-F
Tatoeba-test.kin-eng.kin.eng 32.7 0.502
Tatoeba-test.lin-eng.lin.eng 7.6 0.228
Tatoeba-test.lug-eng.lug.eng 8.2 0.282
Tatoeba-test.multi.eng 22.5 0.389
Tatoeba-test.nya-eng.nya.eng 38.6 0.519
Tatoeba-test.run-eng.run.eng 26.0 0.425
Tatoeba-test.sna-eng.sna.eng 21.8 0.429
Tatoeba-test.swa-eng.swa.eng 5.1 0.197
Tatoeba-test.toi-eng.toi.eng 16.2 0.342
Tatoeba-test.tso-eng.tso.eng 100.0 1.000
Tatoeba-test.umb-eng.umb.eng 6.0 0.190
Tatoeba-test.xho-eng.xho.eng 35.3 0.539
Tatoeba-test.zul-eng.zul.eng 44.6 0.600

opus2m-2020-08-12.zip

Benchmarks

testset BLEU chr-F
Tatoeba-test.kin-eng.kin.eng 31.7 0.481
Tatoeba-test.lin-eng.lin.eng 8.3 0.271
Tatoeba-test.lug-eng.lug.eng 5.3 0.128
Tatoeba-test.multi.eng 23.1 0.394
Tatoeba-test.nya-eng.nya.eng 38.3 0.527
Tatoeba-test.run-eng.run.eng 26.6 0.431
Tatoeba-test.sna-eng.sna.eng 27.5 0.440
Tatoeba-test.swa-eng.swa.eng 4.6 0.195
Tatoeba-test.toi-eng.toi.eng 16.2 0.342
Tatoeba-test.tso-eng.tso.eng 100.0 1.000
Tatoeba-test.umb-eng.umb.eng 8.4 0.231
Tatoeba-test.xho-eng.xho.eng 37.2 0.554
Tatoeba-test.zul-eng.zul.eng 40.9 0.576