-
Notifications
You must be signed in to change notification settings - Fork 0
/
notes.txt
147 lines (128 loc) · 3.09 KB
/
notes.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
Basic-Best 0.6642566651604156
Basic-All 0.6610841780520054
Gold-Basic-Best 0.842728564661298
Gold-Basic-All 0.8721524872152487
Binary-Best 0.6657657657657657
Binary-All 0.6593599298553267
Gold-Binary-Best 0.843276515151515
Gold-Binary-All 0.8726765799256506
Sklearn-Split 0.6773031394750385
Sklearn-No-Split 0.701067615658363
Learning-All-RandomForest 0.7340897878638382
Learning-All-SVC 0.6756352765321375
Learning-Per-Category-RandomForest 0.7349753694581281
Learning-Per-Category-SVC 0.6799800299550675
Learning-Per-Label-RandomForest 0.7345831277750371
Learning-Per-Label-SVC 0.6837606837606838
Learning-Per-Label-LogisticRegression 0.6611026808295397
--- MultiSource-All-RandomForest 0.736426456071076
--- MultiSource-All-SVC 0.678
MultiSource-CrossVal-RandomForest 0.643228856842103
MultiSource-CrossVal-SVC 0.651836695061918
TALP-scenario1 0.639412997903564
TALP-scenario4 0.6050707730595738
Evaluating pipeline:
{
binary: True,
load-best: True,
top-best: True,
top-submits: 6,
weighter: f1,
scorer: expert,
validator: non-zero
}
Fitness=0.666
Search completed: best_fn=0.620, best=
{
binary: True,
load-best: True,
top-best: True,
top-submits: 3,
weighter: f1,
scorer: expert,
discrete-expert: False,
validator: constant,
use-disc-threshold: False,
cont-threshold: 0.2138059222439279
}
Search completed: best_fn=0.675, best=
{
load-best: False,
top-best: False,
n-submits: 1,
submissions: ['hulat-taskAB/576622'],
learning: True,
model-type: randf,
training-mode: category
}
Search completed: best_fn=0.675, best=
{
'load-best': True,
'top-best': False,
'n-submits': 2,
'submissions': ['uhmajakd/576721', 'vsp/576661'],
'learning': True,
'model-type': 'randf',
'training-mode': 'category'
}
Search completed: best_fn=0.739, best=
{
'load-best': True,
'top-best': True,
'top-submits': 1,
'learning': True,
'model-type': 'randf',
'training-mode': 'category'
}
Search completed: best_fn=0.675, best=
{
'load-best': False,
'model-type': 'randf',
'training-mode': 'category',
'weight-learning-votes': True
}
{
'load-best': True,
'learning': True,
'model-type': 'randf',
'training-mode': 'category',
'weight-learning-votes': True
}
F1
==== SCORE ====
0.6164016999842593
==== SCORE ====
0.6472081218274112
TALP
==== SCORE ====
0.6050707730595738
==== SCORE ====
0.639412997903564
Search completed: best_fn=0.619, best=
{
'load-best': False,
'top-best': True,
'top-submits': 5,
'binary': True,
'weighter': 'f1',
'scorer': 'expert',
'discrete-expert': False,
'validator': 'non-zero'
}
Search completed: best_fn=0.619, best=
{
'load-best': False,
'top-best': True,
'top-submits': 6,
'binary': True,
'weighter': 'f1',
'scorer': 'expert',
'discrete-expert': False,
'validator': 'constant',
'use-disc-threshold': False,
'cont-threshold': 0.21054059005160405
}
Reference score: 0.6194377510040161
Validation score: 0.6498915401301519
Scenario2: 0.8228614685844057
Scenario3: 0.6070038910505836