Skip to content

Latest commit

 

History

History
545 lines (544 loc) · 34.4 KB

results.md

File metadata and controls

545 lines (544 loc) · 34.4 KB

Detailed Results

Results of open classification with different known intent ratios (KIR, 0.25, 0.5, 0.75), and labeled ratios (LR, 0.2, 0.4, 0.6, 0.8, 1.0) on BANKING, OOS and StackOverflow datasets. “Open” and “Known” denote the macro f1-score over open class and known classes respectively.

dataset method KIR LR Known Open F1 Acc
banking (K+1)-way 0.25 0.2 63.47 87.46 64.67 81.01
banking (K+1)-way 0.25 0.4 67.77 86.3 68.7 80.2
banking (K+1)-way 0.25 0.6 68.61 84.68 69.41 78.61
banking (K+1)-way 0.25 0.8 68.46 84.0 69.23 78.0
banking (K+1)-way 0.25 1.0 67.7 82.66 68.44 76.66
banking (K+1)-way 0.5 0.2 68.33 76.34 68.54 72.66
banking (K+1)-way 0.5 0.4 75.91 76.74 75.93 75.77
banking (K+1)-way 0.5 0.6 77.55 75.77 77.51 75.99
banking (K+1)-way 0.5 0.8 77.78 74.61 77.7 75.54
banking (K+1)-way 0.5 1.0 77.97 72.58 77.83 74.65
banking (K+1)-way 0.75 0.2 73.53 58.1 73.27 68.96
banking (K+1)-way 0.75 0.4 81.6 62.18 81.27 76.37
banking (K+1)-way 0.75 0.6 83.52 62.42 83.17 78.1
banking (K+1)-way 0.75 0.8 84.57 62.11 84.19 79.03
banking (K+1)-way 0.75 1.0 85.14 59.89 84.71 79.18
banking ADB 0.25 0.2 64.0 82.87 64.94 75.86
banking ADB 0.25 0.4 67.42 83.68 68.24 77.32
banking ADB 0.25 0.6 68.19 83.51 68.95 77.32
banking ADB 0.25 0.8 69.23 84.05 69.97 78.04
banking ADB 0.25 1.0 70.92 85.05 71.63 79.33
banking ADB 0.5 0.2 72.87 74.69 72.91 73.11
banking ADB 0.5 0.4 78.17 77.12 78.14 76.84
banking ADB 0.5 0.6 80.15 78.54 80.11 78.54
banking ADB 0.5 0.8 80.87 78.9 80.82 79.07
banking ADB 0.5 1.0 81.39 79.43 81.34 79.61
banking ADB 0.75 0.2 77.87 58.9 77.55 72.7
banking ADB 0.75 0.4 82.21 61.78 81.86 76.77
banking ADB 0.75 0.6 84.62 64.49 84.28 79.24
banking ADB 0.75 0.8 85.62 65.96 85.29 80.41
banking ADB 0.75 1.0 86.44 67.34 86.11 81.39
banking ARPL 0.25 0.2 0.22 85.94 4.5 75.35
banking ARPL 0.25 0.4 4.73 85.93 8.79 75.56
banking ARPL 0.25 0.6 30.17 86.92 33.01 78.42
banking ARPL 0.25 0.8 55.1 85.82 56.64 78.68
banking ARPL 0.25 1.0 62.99 83.39 64.01 76.8
banking ARPL 0.5 0.2 0.33 67.26 2.04 50.72
banking ARPL 0.5 0.4 26.08 70.4 27.21 58.81
banking ARPL 0.5 0.6 70.8 77.55 70.97 75.32
banking ARPL 0.5 0.8 76.68 75.77 76.66 75.9
banking ARPL 0.5 1.0 77.93 71.79 77.77 74.11
banking ARPL 0.75 0.2 1.1 39.71 1.75 25.21
banking ARPL 0.75 0.4 52.99 50.6 52.95 55.5
banking ARPL 0.75 0.6 81.82 62.75 81.5 77.08
banking ARPL 0.75 0.8 84.63 62.32 84.25 79.1
banking ARPL 0.75 1.0 85.58 61.26 85.16 79.6
banking DA-ADB 0.25 0.2 66.55 87.71 67.61 81.55
banking DA-ADB 0.25 0.4 71.1 87.43 71.92 81.83
banking DA-ADB 0.25 0.6 71.95 87.18 72.71 81.66
banking DA-ADB 0.25 0.8 73.29 86.96 73.98 81.62
banking DA-ADB 0.25 1.0 73.05 86.57 73.73 81.19
banking DA-ADB 0.5 0.2 70.52 78.39 70.72 74.94
banking DA-ADB 0.5 0.4 78.42 80.8 78.48 79.25
banking DA-ADB 0.5 0.6 80.65 81.55 80.67 80.56
banking DA-ADB 0.5 0.8 81.72 81.85 81.72 81.14
banking DA-ADB 0.5 1.0 82.54 81.93 82.53 81.51
banking DA-ADB 0.75 0.2 72.16 58.84 71.93 68.27
banking DA-ADB 0.75 0.4 80.08 64.21 79.81 75.33
banking DA-ADB 0.75 0.6 83.19 66.84 82.91 78.36
banking DA-ADB 0.75 0.8 84.68 68.14 84.4 79.84
banking DA-ADB 0.75 1.0 85.93 69.37 85.65 81.12
banking DOC 0.25 0.2 11.7 77.82 15.01 69.2
banking DOC 0.25 0.4 62.13 83.56 63.21 76.54
banking DOC 0.25 0.6 64.64 80.12 65.41 73.37
banking DOC 0.25 0.8 65.89 78.4 66.52 71.95
banking DOC 0.25 1.0 65.16 76.64 65.74 70.31
banking DOC 0.5 0.2 0.39 55.18 1.8 40.74
banking DOC 0.5 0.4 52.42 67.69 52.81 62.89
banking DOC 0.5 0.6 71.67 75.9 71.78 74.18
banking DOC 0.5 0.8 76.1 74.72 76.07 74.87
banking DOC 0.5 1.0 78.38 72.66 78.24 74.6
banking DOC 0.75 0.2 0.12 23.95 0.53 15.4
banking DOC 0.75 0.4 29.28 40.69 29.47 38.0
banking DOC 0.75 0.6 72.6 58.28 72.36 69.48
banking DOC 0.75 0.8 80.07 62.37 79.77 75.75
banking DOC 0.75 1.0 84.14 63.51 83.79 78.94
banking DeepUnk 0.25 0.2 52.93 65.27 53.55 58.32
banking DeepUnk 0.25 0.4 62.24 75.55 62.9 68.66
banking DeepUnk 0.25 0.6 65.44 79.04 66.12 72.71
banking DeepUnk 0.25 0.8 65.01 77.12 65.62 70.82
banking DeepUnk 0.25 1.0 64.97 76.98 65.57 70.68
banking DeepUnk 0.5 0.2 64.36 59.23 64.23 61.64
banking DeepUnk 0.5 0.4 72.02 65.51 71.85 68.04
banking DeepUnk 0.5 0.6 73.33 65.8 73.14 68.87
banking DeepUnk 0.5 0.8 74.7 66.11 74.48 69.74
banking DeepUnk 0.5 1.0 75.61 67.8 75.41 71.01
banking DeepUnk 0.75 0.2 68.8 43.61 68.37 64.46
banking DeepUnk 0.75 0.4 76.43 48.21 75.95 70.45
banking DeepUnk 0.75 0.6 79.87 49.74 79.36 73.16
banking DeepUnk 0.75 0.8 80.86 50.23 80.34 74.07
banking DeepUnk 0.75 1.0 81.65 50.57 81.12 74.73
banking KNNCL 0.25 0.2 41.22 53.93 41.86 47.06
banking KNNCL 0.25 0.4 62.14 79.69 63.02 72.38
banking KNNCL 0.25 0.6 65.75 81.77 66.55 75.1
banking KNNCL 0.25 0.8 66.66 81.62 67.41 75.19
banking KNNCL 0.25 1.0 65.54 79.34 66.23 73.01
banking KNNCL 0.5 0.2 48.52 44.93 48.43 47.81
banking KNNCL 0.5 0.4 66.23 60.43 66.08 62.92
banking KNNCL 0.5 0.6 71.57 64.19 71.38 67.21
banking KNNCL 0.5 0.8 74.32 66.61 74.12 69.65
banking KNNCL 0.5 1.0 75.16 67.21 74.96 70.41
banking KNNCL 0.75 0.2 49.99 29.95 49.58 49.08
banking KNNCL 0.75 0.4 69.16 42.99 68.72 64.44
banking KNNCL 0.75 0.6 76.22 47.56 75.74 70.12
banking KNNCL 0.75 0.8 79.63 49.93 79.13 72.92
banking KNNCL 0.75 1.0 81.76 51.42 81.25 74.78
banking LOF 0.25 0.2 54.11 64.83 54.65 58.5
banking LOF 0.25 0.4 61.21 72.81 61.79 66.38
banking LOF 0.25 0.6 61.66 72.19 62.18 66.04
banking LOF 0.25 0.8 60.64 70.02 61.11 64.04
banking LOF 0.25 1.0 62.89 72.64 63.38 66.73
banking LOF 0.5 0.2 68.13 60.62 67.94 64.03
banking LOF 0.5 0.4 75.65 70.25 75.51 72.03
banking LOF 0.5 0.6 76.46 69.38 76.28 72.08
banking LOF 0.5 0.8 76.51 67.71 76.29 71.44
banking LOF 0.5 1.0 76.51 66.81 76.26 71.13
banking LOF 0.75 0.2 75.53 48.45 75.07 69.34
banking LOF 0.75 0.4 80.91 51.7 80.41 74.07
banking LOF 0.75 0.6 82.89 53.94 82.4 76.01
banking LOF 0.75 0.8 83.67 54.55 83.18 76.87
banking LOF 0.75 1.0 84.15 54.19 83.64 77.21
banking MDF 0.25 0.2 0.1 85.93 4.39 75.33
banking MDF 0.25 0.4 0.13 85.93 4.42 75.34
banking MDF 0.25 0.6 11.81 86.56 15.55 76.66
banking MDF 0.25 0.8 32.6 86.86 35.32 77.97
banking MDF 0.25 1.0 44.8 85.7 46.85 77.17
banking MDF 0.5 0.2 0.04 67.25 1.76 50.66
banking MDF 0.5 0.4 31.98 69.11 32.93 57.6
banking MDF 0.5 0.6 53.43 66.09 53.75 60.55
banking MDF 0.5 0.8 61.02 61.79 61.04 60.72
banking MDF 0.5 1.0 64.27 57.72 64.1 60.18
banking MDF 0.75 0.2 7.52 40.33 8.07 27.54
banking MDF 0.75 0.4 56.93 41.39 56.67 51.19
banking MDF 0.75 0.6 69.58 39.14 69.06 60.16
banking MDF 0.75 0.8 73.74 35.86 73.09 63.33
banking MDF 0.75 1.0 75.47 33.43 74.76 64.59
banking MSP 0.25 0.2 51.82 54.5 51.95 50.69
banking MSP 0.25 0.4 51.83 47.51 51.61 46.68
banking MSP 0.25 0.6 51.15 43.81 50.78 44.59
banking MSP 0.25 0.8 51.64 44.17 51.27 44.92
banking MSP 0.25 1.0 50.47 39.42 49.92 42.19
banking MSP 0.5 0.2 71.16 63.69 70.97 67.02
banking MSP 0.5 0.4 73.16 54.83 72.69 64.37
banking MSP 0.5 0.6 73.39 51.82 72.83 63.55
banking MSP 0.5 0.8 72.97 46.47 72.29 61.6
banking MSP 0.5 1.0 73.2 46.29 72.51 61.67
banking MSP 0.75 0.2 78.32 55.78 77.94 72.92
banking MSP 0.75 0.4 83.27 53.99 82.77 76.57
banking MSP 0.75 0.6 84.28 49.97 83.7 76.93
banking MSP 0.75 0.8 84.75 48.71 84.14 77.22
banking MSP 0.75 1.0 84.99 46.05 84.33 77.08
banking OpenMax 0.25 0.2 59.71 82.37 60.84 74.88
banking OpenMax 0.25 0.4 60.03 67.83 60.42 61.92
banking OpenMax 0.25 0.6 56.52 58.37 56.61 54.53
banking OpenMax 0.25 0.8 55.89 56.75 55.94 53.44
banking OpenMax 0.25 1.0 53.42 48.52 53.18 47.76
banking OpenMax 0.5 0.2 52.81 74.9 53.38 68.61
banking OpenMax 0.5 0.4 74.05 70.14 73.95 71.61
banking OpenMax 0.5 0.6 74.7 63.9 74.42 69.03
banking OpenMax 0.5 0.8 74.94 56.44 74.46 66.0
banking OpenMax 0.5 1.0 75.16 55.03 74.64 65.53
banking OpenMax 0.75 0.2 26.53 44.19 26.83 38.92
banking OpenMax 0.75 0.4 74.78 58.85 74.51 71.67
banking OpenMax 0.75 0.6 82.56 58.18 82.15 76.92
banking OpenMax 0.75 0.8 84.14 55.08 83.65 77.57
banking OpenMax 0.75 1.0 85.5 53.02 84.95 78.32
banking SEG 0.25 0.2 31.32 33.31 31.42 30.75
banking SEG 0.25 0.4 47.22 56.14 47.66 50.08
banking SEG 0.25 0.6 51.1 57.09 51.4 52.01
banking SEG 0.25 0.8 50.97 54.13 51.12 50.26
banking SEG 0.25 1.0 51.48 51.58 51.49 48.73
banking SEG 0.5 0.2 39.47 24.85 39.09 35.44
banking SEG 0.5 0.4 53.85 38.13 53.45 48.05
banking SEG 0.5 0.6 58.91 41.73 58.47 52.07
banking SEG 0.5 0.8 62.26 43.9 61.79 54.53
banking SEG 0.5 1.0 63.85 43.03 63.32 55.11
banking SEG 0.75 0.2 41.77 19.57 41.4 40.03
banking SEG 0.75 0.4 57.27 30.43 56.82 54.39
banking SEG 0.75 0.6 64.67 35.01 64.16 60.51
banking SEG 0.75 0.8 67.69 38.04 67.19 63.18
banking SEG 0.75 1.0 70.1 37.22 69.54 64.65
oos (K+1)-way 0.25 0.2 71.52 92.92 72.07 88.5
oos (K+1)-way 0.25 0.4 76.08 93.06 76.52 89.01
oos (K+1)-way 0.25 0.6 76.11 92.18 76.52 87.9
oos (K+1)-way 0.25 0.8 75.57 91.71 75.98 87.26
oos (K+1)-way 0.25 1.0 74.02 90.27 74.43 85.36
oos (K+1)-way 0.5 0.2 76.5 86.73 76.63 82.8
oos (K+1)-way 0.5 0.4 80.8 87.05 80.88 84.1
oos (K+1)-way 0.5 0.6 81.72 86.05 81.78 83.55
oos (K+1)-way 0.5 0.8 81.43 84.48 81.47 82.3
oos (K+1)-way 0.5 1.0 81.52 84.25 81.56 82.19
oos (K+1)-way 0.75 0.2 79.53 79.59 79.53 79.79
oos (K+1)-way 0.75 0.4 85.0 81.79 84.97 83.48
oos (K+1)-way 0.75 0.6 86.43 82.15 86.39 84.41
oos (K+1)-way 0.75 0.8 86.8 81.31 86.75 84.24
oos (K+1)-way 0.75 1.0 86.72 79.59 86.66 83.51
oos ADB 0.25 0.2 72.18 90.32 72.65 85.16
oos ADB 0.25 0.4 75.49 91.45 75.9 86.93
oos ADB 0.25 0.6 75.99 91.63 76.4 87.19
oos ADB 0.25 0.8 76.96 92.06 77.35 87.82
oos ADB 0.25 1.0 77.85 92.36 78.23 88.3
oos ADB 0.5 0.2 79.5 85.34 79.58 82.23
oos ADB 0.5 0.4 82.35 86.75 82.41 84.23
oos ADB 0.5 0.6 83.56 87.36 83.61 85.06
oos ADB 0.5 0.8 84.03 87.65 84.07 85.44
oos ADB 0.5 1.0 85.12 88.6 85.16 86.54
oos ADB 0.75 0.2 84.15 81.19 84.12 82.69
oos ADB 0.75 0.4 86.64 82.62 86.61 84.7
oos ADB 0.75 0.6 87.74 83.64 87.71 85.76
oos ADB 0.75 0.8 88.45 84.33 88.41 86.46
oos ADB 0.75 1.0 88.97 84.85 88.94 86.99
oos ARPL 0.25 0.2 0.02 88.89 2.3 80.0
oos ARPL 0.25 0.4 14.09 89.73 16.03 81.79
oos ARPL 0.25 0.6 63.12 92.4 63.87 87.61
oos ARPL 0.25 0.8 72.24 90.66 72.71 85.8
oos ARPL 0.25 1.0 73.01 89.63 73.44 84.51
oos ARPL 0.5 0.2 0.57 75.47 1.55 60.66
oos ARPL 0.5 0.4 67.9 85.83 68.14 81.02
oos ARPL 0.5 0.6 82.25 85.58 82.29 83.38
oos ARPL 0.5 0.8 82.07 84.2 82.09 82.34
oos ARPL 0.5 1.0 80.87 81.81 80.88 80.36
oos ARPL 0.75 0.2 5.05 59.03 5.53 43.08
oos ARPL 0.75 0.4 80.78 80.74 80.78 81.54
oos ARPL 0.75 0.6 87.25 80.82 87.19 84.27
oos ARPL 0.75 0.8 86.84 77.93 86.77 82.89
oos ARPL 0.75 1.0 86.1 74.67 86.0 81.29
oos DA-ADB 0.25 0.2 75.16 93.56 75.64 89.63
oos DA-ADB 0.25 0.4 78.03 93.39 78.43 89.6
oos DA-ADB 0.25 0.6 78.63 93.31 79.01 89.56
oos DA-ADB 0.25 0.8 79.1 93.19 79.47 89.43
oos DA-ADB 0.25 1.0 79.57 93.2 79.92 89.48
oos DA-ADB 0.5 0.2 77.55 88.13 77.69 84.42
oos DA-ADB 0.5 0.4 82.51 89.36 82.6 86.56
oos DA-ADB 0.5 0.6 84.1 89.75 84.18 87.27
oos DA-ADB 0.5 0.8 85.08 90.05 85.15 87.76
oos DA-ADB 0.5 1.0 85.58 90.1 85.64 87.93
oos DA-ADB 0.75 0.2 78.4 80.14 78.42 79.79
oos DA-ADB 0.75 0.4 83.97 83.08 83.97 83.78
oos DA-ADB 0.75 0.6 86.32 84.4 86.3 85.56
oos DA-ADB 0.75 0.8 87.35 85.18 87.33 86.44
oos DA-ADB 0.75 1.0 88.43 86.0 88.41 87.39
oos DOC 0.25 0.2 2.19 69.51 3.91 61.61
oos DOC 0.25 0.4 70.11 92.67 70.69 88.18
oos DOC 0.25 0.6 74.99 91.79 75.42 87.3
oos DOC 0.25 0.8 75.15 91.0 75.55 86.31
oos DOC 0.25 1.0 75.46 90.78 75.86 86.08
oos DOC 0.5 0.2 0.03 67.87 0.93 54.54
oos DOC 0.5 0.4 40.98 80.96 41.51 71.95
oos DOC 0.5 0.6 80.64 88.12 80.74 85.02
oos DOC 0.5 0.8 83.0 87.31 83.06 84.85
oos DOC 0.5 1.0 83.84 87.45 83.89 85.19
oos DOC 0.75 0.2 0.03 45.42 0.43 31.14
oos DOC 0.75 0.4 10.27 48.78 10.61 37.14
oos DOC 0.75 0.6 78.78 79.67 78.78 79.87
oos DOC 0.75 0.8 86.36 83.34 86.33 84.94
oos DOC 0.75 1.0 87.91 83.87 87.87 85.93
oos DeepUnk 0.25 0.2 55.03 69.4 55.4 60.91
oos DeepUnk 0.25 0.4 76.94 92.44 77.33 88.19
oos DeepUnk 0.25 0.6 77.12 92.32 77.51 88.0
oos DeepUnk 0.25 0.8 77.21 92.1 77.59 87.78
oos DeepUnk 0.25 1.0 76.95 91.61 77.32 87.18
oos DeepUnk 0.5 0.2 68.4 69.72 68.42 67.58
oos DeepUnk 0.5 0.4 80.96 86.23 81.03 83.17
oos DeepUnk 0.5 0.6 82.57 87.26 82.63 84.53
oos DeepUnk 0.5 0.8 82.65 86.86 82.71 84.24
oos DeepUnk 0.5 1.0 83.3 87.48 83.35 84.95
oos DeepUnk 0.75 0.2 74.7 67.53 74.64 71.98
oos DeepUnk 0.75 0.4 83.67 80.68 83.64 82.09
oos DeepUnk 0.75 0.6 85.34 82.13 85.32 83.68
oos DeepUnk 0.75 0.8 86.26 82.67 86.23 84.44
oos DeepUnk 0.75 1.0 86.57 82.67 86.53 84.61
oos KNNCL 0.25 0.2 46.64 66.13 47.14 56.78
oos KNNCL 0.25 0.4 73.44 91.73 73.91 87.02
oos KNNCL 0.25 0.6 77.09 92.97 77.5 88.95
oos KNNCL 0.25 0.8 78.1 93.31 78.49 89.48
oos KNNCL 0.25 1.0 78.85 93.56 79.23 89.87
oos KNNCL 0.5 0.2 57.02 63.24 57.1 59.38
oos KNNCL 0.5 0.4 76.55 82.22 76.63 78.76
oos KNNCL 0.5 0.6 80.34 85.36 80.41 82.44
oos KNNCL 0.5 0.8 82.19 87.03 82.26 84.35
oos KNNCL 0.5 1.0 83.25 87.85 83.31 85.32
oos KNNCL 0.75 0.2 57.48 57.97 57.48 58.87
oos KNNCL 0.75 0.4 78.64 74.79 78.6 76.71
oos KNNCL 0.75 0.6 83.18 78.72 83.14 80.94
oos KNNCL 0.75 0.8 85.26 81.04 85.22 83.17
oos KNNCL 0.75 1.0 86.14 82.05 86.1 84.12
oos LOF 0.25 0.2 52.58 65.86 52.92 57.93
oos LOF 0.25 0.4 76.42 92.07 76.82 87.8
oos LOF 0.25 0.6 75.66 91.15 76.06 86.51
oos LOF 0.25 0.8 76.49 91.46 76.87 86.94
oos LOF 0.25 1.0 77.77 91.96 78.13 87.77
oos LOF 0.5 0.2 70.03 69.35 70.02 68.05
oos LOF 0.5 0.4 81.44 86.5 81.51 83.69
oos LOF 0.5 0.6 82.62 86.85 82.68 84.33
oos LOF 0.5 0.8 82.62 86.24 82.67 83.84
oos LOF 0.5 1.0 83.81 87.57 83.86 85.22
oos LOF 0.75 0.2 78.59 68.97 78.51 74.6
oos LOF 0.75 0.4 84.99 81.22 84.96 83.22
oos LOF 0.75 0.6 86.12 81.71 86.08 83.95
oos LOF 0.75 0.8 86.91 82.58 86.88 84.81
oos LOF 0.75 1.0 87.24 82.81 87.2 85.07
oos MDF 0.25 0.2 0.0 88.89 2.28 80.0
oos MDF 0.25 0.4 11.66 89.46 13.65 81.17
oos MDF 0.25 0.6 37.75 89.86 39.09 82.61
oos MDF 0.25 0.8 46.77 87.81 47.82 80.16
oos MDF 0.25 1.0 49.43 84.89 50.34 76.56
oos MDF 0.5 0.2 9.62 76.26 10.49 62.45
oos MDF 0.5 0.4 51.06 75.64 51.39 67.65
oos MDF 0.5 0.6 58.73 70.23 58.88 64.99
oos MDF 0.5 0.8 60.77 65.8 60.84 62.57
oos MDF 0.5 1.0 61.6 62.31 61.61 60.72
oos MDF 0.75 0.2 39.8 63.14 40.01 55.05
oos MDF 0.75 0.4 65.42 61.22 65.38 63.89
oos MDF 0.75 0.6 69.77 56.58 69.65 64.25
oos MDF 0.75 0.8 71.34 53.58 71.18 64.13
oos MDF 0.75 1.0 72.21 51.33 72.02 63.98
oos MSP 0.25 0.2 58.94 76.35 59.39 68.67
oos MSP 0.25 0.4 54.48 67.22 54.8 60.07
oos MSP 0.25 0.6 53.56 65.11 53.86 58.27
oos MSP 0.25 0.8 51.68 61.11 51.93 54.81
oos MSP 0.25 1.0 51.02 59.26 51.23 53.38
oos MSP 0.5 0.2 76.74 78.27 76.76 76.35
oos MSP 0.5 0.4 75.03 71.39 74.98 71.61
oos MSP 0.5 0.6 73.68 67.04 73.6 68.74
oos MSP 0.5 0.8 73.6 66.07 73.51 68.22
oos MSP 0.5 1.0 72.82 63.71 72.7 66.68
oos MSP 0.75 0.2 84.13 77.43 84.07 81.09
oos MSP 0.75 0.4 84.94 73.57 84.84 80.1
oos MSP 0.75 0.6 84.45 69.61 84.31 78.49
oos MSP 0.75 0.8 84.51 68.67 84.37 78.24
oos MSP 0.75 1.0 83.65 63.86 83.48 76.19
oos OpenMax 0.25 0.2 30.49 90.72 32.04 83.82
oos OpenMax 0.25 0.4 70.27 92.07 70.83 87.46
oos OpenMax 0.25 0.6 69.79 87.19 70.23 81.33
oos OpenMax 0.25 0.8 65.91 81.58 66.32 74.73
oos OpenMax 0.25 1.0 62.65 77.51 63.03 70.27
oos OpenMax 0.5 0.2 3.56 75.82 4.51 61.41
oos OpenMax 0.5 0.4 40.99 81.15 41.52 72.46
oos OpenMax 0.5 0.6 68.95 85.31 69.17 80.92
oos OpenMax 0.5 0.8 78.66 84.91 78.74 82.24
oos OpenMax 0.5 1.0 79.83 82.15 79.86 80.22
oos OpenMax 0.75 0.2 0.27 58.25 0.79 41.15
oos OpenMax 0.75 0.4 14.33 60.63 14.74 47.03
oos OpenMax 0.75 0.6 42.7 66.95 42.91 60.65
oos OpenMax 0.75 0.8 66.39 74.06 66.46 73.11
oos OpenMax 0.75 1.0 71.14 75.18 71.17 75.36
oos SEG 0.25 0.2 31.63 42.73 31.92 35.7
oos SEG 0.25 0.4 45.21 64.33 45.7 54.91
oos SEG 0.25 0.6 48.81 67.62 49.29 58.82
oos SEG 0.25 0.8 47.97 64.36 48.39 56.26
oos SEG 0.25 1.0 46.67 59.22 47.0 52.18
oos SEG 0.5 0.2 34.54 32.4 34.51 33.27
oos SEG 0.5 0.4 42.85 42.9 42.85 41.91
oos SEG 0.5 0.6 52.09 51.14 52.08 50.2
oos SEG 0.5 0.8 58.35 57.85 58.35 56.77
oos SEG 0.5 1.0 62.57 61.34 62.55 60.67
oos SEG 0.75 0.2 24.18 28.04 24.22 26.46
oos SEG 0.75 0.4 25.86 26.32 25.86 27.44
oos SEG 0.75 0.6 29.38 29.48 29.38 30.72
oos SEG 0.75 0.8 33.67 34.76 33.68 35.19
oos SEG 0.75 1.0 42.72 40.74 42.7 42.78
stackoverflow (K+1)-way 0.25 0.2 67.06 85.28 70.04 79.07
stackoverflow (K+1)-way 0.25 0.4 62.78 77.47 65.23 70.9
stackoverflow (K+1)-way 0.25 0.6 56.78 68.48 58.73 62.23
stackoverflow (K+1)-way 0.25 0.8 54.55 61.33 55.68 56.59
stackoverflow (K+1)-way 0.25 1.0 50.54 52.23 50.82 49.75
stackoverflow (K+1)-way 0.5 0.2 76.97 79.16 77.17 77.67
stackoverflow (K+1)-way 0.5 0.4 75.37 72.53 75.11 73.52
stackoverflow (K+1)-way 0.5 0.6 73.28 64.6 72.49 68.95
stackoverflow (K+1)-way 0.5 0.8 72.05 58.93 70.85 66.16
stackoverflow (K+1)-way 0.5 1.0 70.53 51.69 68.81 62.57
stackoverflow (K+1)-way 0.75 0.2 81.64 65.0 80.6 76.89
stackoverflow (K+1)-way 0.75 0.4 81.58 58.57 80.14 75.84
stackoverflow (K+1)-way 0.75 0.6 81.66 54.76 79.98 75.64
stackoverflow (K+1)-way 0.75 0.8 81.76 52.42 79.93 75.43
stackoverflow (K+1)-way 0.75 1.0 81.2 45.22 78.95 74.0
stackoverflow ADB 0.25 0.2 73.38 86.99 75.65 81.99
stackoverflow ADB 0.25 0.4 74.91 88.61 77.2 83.9
stackoverflow ADB 0.25 0.6 77.3 91.18 79.62 87.01
stackoverflow ADB 0.25 0.8 77.22 90.89 79.5 86.64
stackoverflow ADB 0.25 1.0 77.62 90.96 79.85 86.75
stackoverflow ADB 0.5 0.2 83.02 85.7 83.27 84.22
stackoverflow ADB 0.5 0.4 84.37 86.97 84.61 85.63
stackoverflow ADB 0.5 0.6 84.84 87.32 85.07 86.08
stackoverflow ADB 0.5 0.8 84.96 87.36 85.17 86.13
stackoverflow ADB 0.5 1.0 85.32 87.7 85.54 86.49
stackoverflow ADB 0.75 0.2 85.47 72.4 84.65 81.29
stackoverflow ADB 0.75 0.4 86.17 73.0 85.34 81.99
stackoverflow ADB 0.75 0.6 86.51 73.52 85.69 82.4
stackoverflow ADB 0.75 0.8 86.76 73.97 85.96 82.74
stackoverflow ADB 0.75 1.0 86.91 74.1 86.11 82.89
stackoverflow ARPL 0.25 0.2 47.75 87.67 54.41 80.5
stackoverflow ARPL 0.25 0.4 67.95 85.69 70.91 79.73
stackoverflow ARPL 0.25 0.6 62.91 77.67 65.37 71.37
stackoverflow ARPL 0.25 0.8 62.43 75.47 64.61 69.01
stackoverflow ARPL 0.25 1.0 60.55 72.95 62.62 66.76
stackoverflow ARPL 0.5 0.2 61.82 79.71 63.45 74.82
stackoverflow ARPL 0.5 0.4 81.49 82.95 81.62 81.97
stackoverflow ARPL 0.5 0.6 79.8 78.6 79.69 78.69
stackoverflow ARPL 0.5 0.8 78.52 75.22 78.22 76.51
stackoverflow ARPL 0.5 1.0 78.26 73.97 77.87 75.65
stackoverflow ARPL 0.75 0.2 80.02 67.78 79.25 76.65
stackoverflow ARPL 0.75 0.4 86.06 71.21 85.14 81.78
stackoverflow ARPL 0.75 0.6 85.51 66.96 84.35 80.58
stackoverflow ARPL 0.75 0.8 85.28 64.4 83.97 79.93
stackoverflow ARPL 0.75 1.0 85.24 62.99 83.85 79.64
stackoverflow DA-ADB 0.25 0.2 79.95 92.22 81.99 88.4
stackoverflow DA-ADB 0.25 0.4 80.4 92.58 82.43 88.92
stackoverflow DA-ADB 0.25 0.6 81.38 93.39 83.38 90.05
stackoverflow DA-ADB 0.25 0.8 80.96 92.93 82.96 89.41
stackoverflow DA-ADB 0.25 1.0 80.87 92.65 82.83 89.07
stackoverflow DA-ADB 0.5 0.2 84.99 87.91 85.26 86.54
stackoverflow DA-ADB 0.5 0.4 85.54 88.1 85.77 86.84
stackoverflow DA-ADB 0.5 0.6 86.18 88.5 86.39 87.34
stackoverflow DA-ADB 0.5 0.8 86.36 88.53 86.56 87.41
stackoverflow DA-ADB 0.5 1.0 86.71 88.86 86.91 87.78
stackoverflow DA-ADB 0.75 0.2 86.23 73.63 85.45 82.19
stackoverflow DA-ADB 0.75 0.4 87.02 74.11 86.22 82.94
stackoverflow DA-ADB 0.75 0.6 87.22 74.07 86.39 83.07
stackoverflow DA-ADB 0.75 0.8 87.38 74.07 86.55 83.19
stackoverflow DA-ADB 0.75 1.0 87.66 74.55 86.84 83.56
stackoverflow DOC 0.25 0.2 64.84 79.08 67.21 72.91
stackoverflow DOC 0.25 0.4 58.47 67.92 60.04 62.01
stackoverflow DOC 0.25 0.6 59.88 69.9 61.55 64.2
stackoverflow DOC 0.25 0.8 57.97 66.11 59.32 60.9
stackoverflow DOC 0.25 1.0 56.3 62.5 57.34 57.75
stackoverflow DOC 0.5 0.2 79.55 80.26 79.62 79.4
stackoverflow DOC 0.5 0.4 78.58 76.8 78.42 77.09
stackoverflow DOC 0.5 0.6 78.07 74.11 77.71 75.47
stackoverflow DOC 0.5 0.8 76.74 71.31 76.24 73.64
stackoverflow DOC 0.5 1.0 77.37 71.18 76.8 73.88
stackoverflow DOC 0.75 0.2 85.26 70.86 84.36 81.17
stackoverflow DOC 0.75 0.4 85.27 68.57 84.23 80.83
stackoverflow DOC 0.75 0.6 85.4 67.84 84.3 80.86
stackoverflow DOC 0.75 0.8 85.49 66.42 84.3 80.66
stackoverflow DOC 0.75 1.0 85.64 65.32 84.37 80.55
stackoverflow DeepUnk 0.25 0.2 56.41 57.68 56.62 55.22
stackoverflow DeepUnk 0.25 0.4 50.86 49.11 50.57 47.52
stackoverflow DeepUnk 0.25 0.6 49.43 44.76 48.65 44.81
stackoverflow DeepUnk 0.25 0.8 48.61 42.21 47.54 43.06
stackoverflow DeepUnk 0.25 1.0 47.39 36.87 45.64 40.03
stackoverflow DeepUnk 0.5 0.2 68.97 47.87 67.06 59.48
stackoverflow DeepUnk 0.5 0.4 69.45 45.75 67.3 58.98
stackoverflow DeepUnk 0.5 0.6 69.02 40.74 66.44 57.2
stackoverflow DeepUnk 0.5 0.8 68.84 39.86 66.21 57.12
stackoverflow DeepUnk 0.5 1.0 67.67 35.8 64.78 55.46
stackoverflow DeepUnk 0.75 0.2 79.32 43.74 77.1 71.76
stackoverflow DeepUnk 0.75 0.4 79.63 37.99 77.03 71.27
stackoverflow DeepUnk 0.75 0.6 80.03 37.95 77.4 71.64
stackoverflow DeepUnk 0.75 0.8 79.96 34.05 77.09 71.1
stackoverflow DeepUnk 0.75 1.0 80.51 34.38 77.63 71.56
stackoverflow KNNCL 0.25 0.2 45.63 35.9 44.01 39.88
stackoverflow KNNCL 0.25 0.4 46.13 35.91 44.43 40.34
stackoverflow KNNCL 0.25 0.6 43.06 22.41 39.62 31.94
stackoverflow KNNCL 0.25 0.8 43.0 19.77 39.13 31.04
stackoverflow KNNCL 0.25 1.0 41.79 15.26 37.37 28.65
stackoverflow KNNCL 0.5 0.2 61.62 22.86 58.09 48.52
stackoverflow KNNCL 0.5 0.4 61.47 13.4 57.1 46.27
stackoverflow KNNCL 0.5 0.6 61.46 10.83 56.86 45.8
stackoverflow KNNCL 0.5 0.8 61.43 9.09 56.67 45.49
stackoverflow KNNCL 0.5 1.0 61.5 8.5 56.69 45.38
stackoverflow KNNCL 0.75 0.2 74.3 18.76 70.82 64.77
stackoverflow KNNCL 0.75 0.4 74.97 11.66 71.01 64.64
stackoverflow KNNCL 0.75 0.6 75.6 10.01 71.5 64.98
stackoverflow KNNCL 0.75 0.8 76.0 9.17 71.82 65.22
stackoverflow KNNCL 0.75 1.0 76.16 7.19 71.85 65.01
stackoverflow LOF 0.25 0.2 41.75 17.81 37.76 29.33
stackoverflow LOF 0.25 0.4 40.61 11.73 35.8 26.65
stackoverflow LOF 0.25 0.6 40.15 8.99 34.96 25.63
stackoverflow LOF 0.25 0.8 40.56 10.32 35.52 26.31
stackoverflow LOF 0.25 1.0 40.92 7.14 35.29 25.02
stackoverflow LOF 0.5 0.2 60.92 14.07 56.66 46.29
stackoverflow LOF 0.5 0.4 61.45 9.75 56.75 45.47
stackoverflow LOF 0.5 0.6 61.7 6.71 56.7 44.93
stackoverflow LOF 0.5 0.8 61.67 6.66 56.67 45.0
stackoverflow LOF 0.5 1.0 61.71 5.18 56.57 44.56
stackoverflow LOF 0.75 0.2 75.23 13.19 71.36 65.2
stackoverflow LOF 0.75 0.4 75.77 7.43 71.5 64.95
stackoverflow LOF 0.75 0.6 75.94 6.49 71.6 65.0
stackoverflow LOF 0.75 0.8 76.06 5.02 71.62 64.87
stackoverflow LOF 0.75 1.0 76.31 5.22 71.87 65.05
stackoverflow MDF 0.25 0.2 0.01 85.72 14.3 75.0
stackoverflow MDF 0.25 0.4 0.05 85.72 14.33 75.01
stackoverflow MDF 0.25 0.6 12.86 86.37 25.11 76.4
stackoverflow MDF 0.25 0.8 39.32 86.56 47.19 77.84
stackoverflow MDF 0.25 1.0 48.13 83.03 53.95 74.1
stackoverflow MDF 0.5 0.2 0.03 66.67 6.09 50.01
stackoverflow MDF 0.5 0.4 39.96 69.86 42.68 59.66
stackoverflow MDF 0.5 0.6 58.45 64.37 58.99 61.16
stackoverflow MDF 0.5 0.8 61.55 56.23 61.07 58.35
stackoverflow MDF 0.5 1.0 62.6 50.19 61.47 56.46
stackoverflow MDF 0.75 0.2 11.86 41.25 13.7 29.49
stackoverflow MDF 0.75 0.4 63.01 41.88 61.69 55.4
stackoverflow MDF 0.75 0.6 70.39 35.02 68.18 60.32
stackoverflow MDF 0.75 0.8 72.73 30.98 70.12 61.99
stackoverflow MDF 0.75 1.0 73.96 28.52 71.12 62.98
stackoverflow MSP 0.25 0.2 42.1 16.39 37.81 29.42
stackoverflow MSP 0.25 0.4 42.16 14.14 37.49 28.69
stackoverflow MSP 0.25 0.6 42.36 13.02 37.47 28.32
stackoverflow MSP 0.25 0.8 43.2 14.48 38.41 29.07
stackoverflow MSP 0.25 1.0 42.66 11.66 37.49 27.91
stackoverflow MSP 0.5 0.2 66.65 39.93 64.22 56.66
stackoverflow MSP 0.5 0.4 66.45 33.14 63.42 54.71
stackoverflow MSP 0.5 0.6 67.07 32.85 63.96 54.88
stackoverflow MSP 0.5 0.8 66.92 30.01 63.57 54.06
stackoverflow MSP 0.5 1.0 66.28 26.94 62.7 53.23
stackoverflow MSP 0.75 0.2 79.5 41.89 77.15 72.0
stackoverflow MSP 0.75 0.4 80.11 37.67 77.46 72.04
stackoverflow MSP 0.75 0.6 80.11 33.79 77.22 71.78
stackoverflow MSP 0.75 0.8 80.57 33.78 77.65 72.15
stackoverflow MSP 0.75 1.0 81.42 37.86 78.7 73.2
stackoverflow OpenMax 0.25 0.2 50.5 50.9 50.56 48.85
stackoverflow OpenMax 0.25 0.4 47.45 41.47 46.45 42.92
stackoverflow OpenMax 0.25 0.6 45.94 33.66 43.9 38.34
stackoverflow OpenMax 0.25 0.8 47.66 37.56 45.98 40.77
stackoverflow OpenMax 0.25 1.0 47.51 34.52 45.35 38.97
stackoverflow OpenMax 0.5 0.2 73.69 66.05 72.99 69.68
stackoverflow OpenMax 0.5 0.4 70.3 52.37 68.67 62.82
stackoverflow OpenMax 0.5 0.6 70.65 51.58 68.91 62.54
stackoverflow OpenMax 0.5 0.8 69.96 47.49 67.92 60.91
stackoverflow OpenMax 0.5 1.0 69.88 46.11 67.72 60.27
stackoverflow OpenMax 0.75 0.2 82.56 59.18 81.1 76.72
stackoverflow OpenMax 0.75 0.4 82.09 52.15 80.22 75.42
stackoverflow OpenMax 0.75 0.6 82.57 51.92 80.65 75.84
stackoverflow OpenMax 0.75 0.8 82.12 46.54 79.9 74.73
stackoverflow OpenMax 0.75 1.0 82.98 49.69 80.9 75.78
stackoverflow SEG 0.25 0.2 39.07 15.93 35.21 27.18
stackoverflow SEG 0.25 0.4 39.15 8.33 34.01 24.34
stackoverflow SEG 0.25 0.6 40.0 5.31 34.22 23.44
stackoverflow SEG 0.25 0.8 40.01 5.3 34.23 23.53
stackoverflow SEG 0.25 1.0 40.44 4.19 34.4 23.33
stackoverflow SEG 0.5 0.2 59.07 19.13 55.44 45.15
stackoverflow SEG 0.5 0.4 59.11 8.8 54.53 42.96
stackoverflow SEG 0.5 0.6 59.49 4.63 54.51 42.25
stackoverflow SEG 0.5 0.8 59.84 4.6 54.82 42.74
stackoverflow SEG 0.5 1.0 60.14 4.72 55.1 43.04
stackoverflow SEG 0.75 0.2 71.4 16.56 67.97 61.23
stackoverflow SEG 0.75 0.4 72.26 8.74 68.29 61.34
stackoverflow SEG 0.75 0.6 73.0 6.7 68.86 61.82
stackoverflow SEG 0.75 0.8 73.6 6.76 69.43 62.24
stackoverflow SEG 0.75 1.0 74.24 6.0 69.97 62.72