Skip to content

Latest commit

 

History

History
 
 

gmq-gmq

README.md

opus-2020-07-06.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan fao isl nno nob swe
  • target language(s): dan fao isl nno nob swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-07-06.zip
  • test set translations: opus-2020-07-06.test.txt
  • test set scores: opus-2020-07-06.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-fao.dan.fao 8.1 0.122
Tatoeba-test.dan-isl.dan.isl 70.7 0.909
Tatoeba-test.dan-nor.dan.nor 12.1 0.417
Tatoeba-test.dan-swe.dan.swe 67.5 0.800
Tatoeba-test.fao-dan.fao.dan 18.0 0.474
Tatoeba-test.fao-isl.fao.isl 11.3 0.262
Tatoeba-test.fao-nor.fao.nor 7.9 0.299
Tatoeba-test.fao-swe.fao.swe 35.4 0.830
Tatoeba-test.isl-dan.isl.dan 100.0 1.000
Tatoeba-test.isl-fao.isl.fao 14.5 0.206
Tatoeba-test.isl-nor.isl.nor 14.1 0.396
Tatoeba-test.isl-swe.isl.swe 73.5 0.793
Tatoeba-test.multi.multi 67.5 0.799
Tatoeba-test.nor-dan.nor.dan 52.9 0.713
Tatoeba-test.nor-fao.nor.fao 2.0 0.228
Tatoeba-test.nor-isl.nor.isl 20.8 0.453
Tatoeba-test.nor-nor.nor.nor 11.2 0.419
Tatoeba-test.nor-swe.nor.swe 52.7 0.701
Tatoeba-test.swe-dan.swe.dan 67.5 0.799
Tatoeba-test.swe-fao.swe.fao 0.0 0.279
Tatoeba-test.swe-isl.swe.isl 70.7 0.822
Tatoeba-test.swe-nor.swe.nor 23.4 0.519

opus-2020-07-21.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan fao isl nno nob swe
  • target language(s): dan fao isl nno nob swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-07-21.zip
  • test set translations: opus-2020-07-21.test.txt
  • test set scores: opus-2020-07-21.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-fao.dan.fao 8.1 0.173
Tatoeba-test.dan-isl.dan.isl 52.5 0.827
Tatoeba-test.dan-nor.dan.nor 62.8 0.769
Tatoeba-test.dan-swe.dan.swe 67.5 0.802
Tatoeba-test.fao-dan.fao.dan 14.5 0.255
Tatoeba-test.fao-isl.fao.isl 26.3 0.359
Tatoeba-test.fao-nor.fao.nor 36.5 0.462
Tatoeba-test.fao-swe.fao.swe 0.0 0.632
Tatoeba-test.isl-dan.isl.dan 67.0 0.739
Tatoeba-test.isl-fao.isl.fao 14.5 0.226
Tatoeba-test.isl-nor.isl.nor 50.2 0.650
Tatoeba-test.isl-swe.isl.swe 100.0 1.000
Tatoeba-test.multi.multi 64.9 0.783
Tatoeba-test.nor-dan.nor.dan 66.0 0.800
Tatoeba-test.nor-fao.nor.fao 9.9 0.345
Tatoeba-test.nor-isl.nor.isl 38.5 0.588
Tatoeba-test.nor-nor.nor.nor 52.4 0.727
Tatoeba-test.nor-swe.nor.swe 67.2 0.796
Tatoeba-test.swe-dan.swe.dan 68.0 0.803
Tatoeba-test.swe-fao.swe.fao 0.0 0.268
Tatoeba-test.swe-isl.swe.isl 32.5 0.623
Tatoeba-test.swe-nor.swe.nor 61.6 0.763

opus-2020-07-27.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan fao isl nno nob swe
  • target language(s): dan fao isl nno nob swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-07-27.zip
  • test set translations: opus-2020-07-27.test.txt
  • test set scores: opus-2020-07-27.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-fao.dan.fao 8.1 0.173
Tatoeba-test.dan-isl.dan.isl 52.5 0.827
Tatoeba-test.dan-nor.dan.nor 62.8 0.772
Tatoeba-test.dan-swe.dan.swe 67.6 0.802
Tatoeba-test.fao-dan.fao.dan 11.3 0.306
Tatoeba-test.fao-isl.fao.isl 26.3 0.359
Tatoeba-test.fao-nor.fao.nor 36.8 0.531
Tatoeba-test.fao-swe.fao.swe 0.0 0.632
Tatoeba-test.isl-dan.isl.dan 67.0 0.739
Tatoeba-test.isl-fao.isl.fao 14.5 0.243
Tatoeba-test.isl-nor.isl.nor 51.8 0.674
Tatoeba-test.isl-swe.isl.swe 100.0 1.000
Tatoeba-test.multi.multi 64.7 0.782
Tatoeba-test.nor-dan.nor.dan 65.6 0.797
Tatoeba-test.nor-fao.nor.fao 9.4 0.362
Tatoeba-test.nor-isl.nor.isl 38.8 0.587
Tatoeba-test.nor-nor.nor.nor 51.9 0.721
Tatoeba-test.nor-swe.nor.swe 66.5 0.789
Tatoeba-test.swe-dan.swe.dan 67.6 0.802
Tatoeba-test.swe-fao.swe.fao 0.0 0.268
Tatoeba-test.swe-isl.swe.isl 65.8 0.914
Tatoeba-test.swe-nor.swe.nor 60.6 0.755

opus-2020-09-26.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • target language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-09-26.zip
  • test set translations: opus-2020-09-26.test.txt
  • test set scores: opus-2020-09-26.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-eng.dan.eng 59.1 0.737
Tatoeba-test.dan-fao.dan.fao 6.6 0.162
Tatoeba-test.dan-isl.dan.isl 65.8 0.914
Tatoeba-test.dan-nor.dan.nor 74.3 0.849
Tatoeba-test.dan-swe.dan.swe 69.5 0.818
Tatoeba-test.eng-dan.eng.dan 57.0 0.717
Tatoeba-test.eng-fao.eng.fao 8.3 0.305
Tatoeba-test.eng-isl.eng.isl 24.2 0.505
Tatoeba-test.eng-non.eng.non 0.3 0.160
Tatoeba-test.eng-nor.eng.nor 51.7 0.681
Tatoeba-test.eng-swe.eng.swe 57.3 0.710
Tatoeba-test.fao-dan.fao.dan 23.0 0.536
Tatoeba-test.fao-eng.fao.eng 26.0 0.454
Tatoeba-test.fao-isl.fao.isl 19.0 0.303
Tatoeba-test.fao-nor.fao.nor 47.8 0.631
Tatoeba-test.fao-swe.fao.swe 0.0 1.000
Tatoeba-test.isl-dan.isl.dan 77.7 0.901
Tatoeba-test.isl-eng.isl.eng 49.6 0.659
Tatoeba-test.isl-fao.isl.fao 14.5 0.183
Tatoeba-test.isl-nor.isl.nor 60.5 0.761
Tatoeba-test.isl-swe.isl.swe 60.0 0.800
Tatoeba-test.multi.multi 57.0 0.716
Tatoeba-test.non-eng.non.eng 26.7 0.501
Tatoeba-test.nor-dan.nor.dan 71.5 0.834
Tatoeba-test.nor-eng.nor.eng 54.2 0.694
Tatoeba-test.nor-fao.nor.fao 13.1 0.377
Tatoeba-test.nor-isl.nor.isl 29.7 0.545
Tatoeba-test.nor-nor.nor.nor 61.9 0.786
Tatoeba-test.nor-swe.nor.swe 72.9 0.838
Tatoeba-test.swe-dan.swe.dan 68.7 0.809
Tatoeba-test.swe-eng.swe.eng 60.9 0.737
Tatoeba-test.swe-fao.swe.fao 12.7 0.290
Tatoeba-test.swe-isl.swe.isl 65.8 0.914
Tatoeba-test.swe-nor.swe.nor 72.0 0.832

opus-2020-10-04.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • target language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-10-04.zip
  • test set translations: opus-2020-10-04.test.txt
  • test set scores: opus-2020-10-04.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-eng.dan.eng 59.2 0.738
Tatoeba-test.dan-fao.dan.fao 6.6 0.171
Tatoeba-test.dan-isl.dan.isl 46.7 0.758
Tatoeba-test.dan-nor.dan.nor 74.1 0.849
Tatoeba-test.dan-swe.dan.swe 69.3 0.818
Tatoeba-test.eng-dan.eng.dan 57.1 0.719
Tatoeba-test.eng-fao.eng.fao 8.9 0.315
Tatoeba-test.eng-isl.eng.isl 24.3 0.506
Tatoeba-test.eng-non.eng.non 0.4 0.182
Tatoeba-test.eng-nor.eng.nor 51.9 0.682
Tatoeba-test.eng-swe.eng.swe 57.3 0.712
Tatoeba-test.fao-dan.fao.dan 23.0 0.536
Tatoeba-test.fao-eng.fao.eng 25.4 0.453
Tatoeba-test.fao-isl.fao.isl 15.2 0.304
Tatoeba-test.fao-nor.fao.nor 43.9 0.602
Tatoeba-test.fao-swe.fao.swe 0.0 1.000
Tatoeba-test.isl-dan.isl.dan 77.7 0.901
Tatoeba-test.isl-eng.isl.eng 49.7 0.660
Tatoeba-test.isl-fao.isl.fao 14.5 0.207
Tatoeba-test.isl-nor.isl.nor 61.9 0.772
Tatoeba-test.isl-swe.isl.swe 60.0 0.800
Tatoeba-test.multi.multi 57.1 0.717
Tatoeba-test.non-eng.non.eng 30.0 0.523
Tatoeba-test.nor-dan.nor.dan 71.1 0.831
Tatoeba-test.nor-eng.nor.eng 54.2 0.695
Tatoeba-test.nor-fao.nor.fao 9.9 0.343
Tatoeba-test.nor-isl.nor.isl 29.3 0.543
Tatoeba-test.nor-nor.nor.nor 61.0 0.780
Tatoeba-test.nor-swe.nor.swe 72.5 0.839
Tatoeba-test.swe-dan.swe.dan 68.7 0.808
Tatoeba-test.swe-eng.swe.eng 61.1 0.738
Tatoeba-test.swe-fao.swe.fao 19.0 0.164
Tatoeba-test.swe-isl.swe.isl 46.7 0.784
Tatoeba-test.swe-nor.swe.nor 72.9 0.835

opus-2021-02-16.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan eng fao isl nno nob non swe
  • target language(s): dan eng fao isl nno nob non swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • valid language labels: >>eng<< >>isl<< >>swe<< >>dan<< >>nob<< >>nno<< >>fao<<
  • download: opus-2021-02-16.zip
  • test set translations: opus-2021-02-16.test.txt
  • test set scores: opus-2021-02-16.eval.txt

Benchmarks

testset BLEU chr-F #sent #words BP
Tatoeba-test.multi-multi 56.3 0.709 10000 72790 0.974

opus-2021-02-17.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan eng fao isl nno nob non swe
  • target language(s): dan eng fao isl nno nob non swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • valid language labels: >>eng<< >>isl<< >>swe<< >>dan<< >>nob<< >>nno<< >>fao<<
  • download: opus-2021-02-17.zip
  • test set translations: opus-2021-02-17.test.txt
  • test set scores: opus-2021-02-17.eval.txt

Benchmarks

testset BLEU chr-F #sent #words BP
Tatoeba-test.multi-multi 56.3 0.709 10000 72790 0.974

opus-2021-02-18.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan fao isl nno nob swe
  • target language(s): dan fao isl nno nob swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • valid language labels: >>eng<< >>isl<< >>swe<< >>dan<< >>nob<< >>nno<< >>fao<<
  • download: opus-2021-02-18.zip
  • test set translations: opus-2021-02-18.test.txt
  • test set scores: opus-2021-02-18.eval.txt

Benchmarks

testset BLEU chr-F #sent #words BP
Tatoeba-test.dan-fao 6.6 0.171 1 6 1.000
Tatoeba-test.dan-isl 46.7 0.758 1 10 1.000
Tatoeba-test.dan-nno 52.8 0.718 12 71 1.000
Tatoeba-test.dan-nob 74.1 0.849 1299 9617 0.996
Tatoeba-test.dan-nor 74.0 0.848 1311 9688 0.996
Tatoeba-test.dan-swe 69.1 0.817 1550 10078 0.988
Tatoeba-test.fao-dan 23.0 0.536 1 6 1.000
Tatoeba-test.fao-isl 15.2 0.304 2 7 1.000
Tatoeba-test.fao-nor 43.9 0.602 21 127 1.000
Tatoeba-test.fao-swe 0.0 1.000 1 3 1.000
Tatoeba-test.isl-dan 77.7 0.901 1 12 0.913
Tatoeba-test.isl-fao 14.5 0.207 2 7 1.000
Tatoeba-test.isl-nor 61.6 0.770 126 921 0.971
Tatoeba-test.isl-swe 60.0 0.800 1 12 1.000
Tatoeba-test.multi-multi 56.3 0.709 10000 72790 0.974
Tatoeba-test.nno-dan 84.1 0.858 12 71 0.971
Tatoeba-test.nno-nob 75.8 0.858 474 3167 0.995
Tatoeba-test.nno-swe 39.8 0.698 2 11 0.905
Tatoeba-test.nob-dan 71.1 0.831 1299 9792 0.998
Tatoeba-test.nob-nno 45.7 0.699 474 3184 1.000
Tatoeba-test.nob-swe 72.1 0.837 560 3660 0.991
Tatoeba-test.nor-dan 71.2 0.831 1311 9863 0.998
Tatoeba-test.nor-fao 9.9 0.343 21 126 0.891
Tatoeba-test.nor-isl 29.3 0.543 126 882 0.975
Tatoeba-test.nor-nor 61.0 0.779 948 6351 1.000
Tatoeba-test.nor-swe 72.1 0.837 562 3671 0.991
Tatoeba-test.swe-dan 68.5 0.808 1550 10260 0.990
Tatoeba-test.swe-fao 19.0 0.164 1 3 1.000
Tatoeba-test.swe-isl 46.7 0.784 1 10 1.000
Tatoeba-test.swe-nno 20.4 0.531 2 10 1.000
Tatoeba-test.swe-nob 72.8 0.834 560 3671 0.991
Tatoeba-test.swe-nor 72.7 0.833 562 3681 0.992