ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAH
1
SemEval-2018 Task 1: AIT-2018 Official Leaderboard
2
75 Teams have participated across the 5 subtasks. Click on indididual sheets to see results for each task.
3
1a. EI-reg (emotion intensity regression) English
4
#UserEntriesDate of Last EntryTeam NamePearson (all instances)Pearson (gold in 0.5-1)
5
avg (all instances)avgangerfearjoysadness
6
32301/22/18KU_MTL0.57
0.521 (35)
0.606 (31)
0.538 (36)
0.563 (33)
0.40.540.30.450.325hardik.meisheri301/28/18TCS Research0.764 (5)0.775 (5)0.735 (4)0.770 (4)0.776 (3)0.572 (6)0.636 (6)0.491 (16)0.556 (3)0.607 (5)
7
1SemEval-2018 top score702/08/18SeerNet0.799 (1)
0.827 (1)
0.779 (1)
0.792 (1)
0.798 (1)
0.638 (1)0.708 (1)0.608 (1)0.568 (1)0.666 (1)
8
37SVM_Unigrams_Baseline101/31/18AIT2018 Organizers0.520 (37)
0.526 (34)
0.525 (35)
0.575 (34)
0.453 (38)
0.396 (33)0.455 (33)0.302 (36)0.476 (20)0.350 (38)10zzx2017301/14/18nlpzzx0.727 (10)0.716 (15)0.726 (9)0.736 (9)0.729 (7)0.555 (10)0.607 (12)0.519 (9)0.529 (8)0.565 (13)
9
38AngelDeborahSuseelan501/27/18SSN_MLRG1 0.486 (38)
0.490 (38)
0.490 (38)
0.502 (38)
0.461 (37)
0.378 (37)0.388 (36)0.335 (34)0.385 (35)0.405 (37)11mhjabreel602/08/18EiTAKA0.724 (11)0.731 (13)0.733 (5)0.722 (12)0.711 (12)0.560 (8)0.606 (14)0.522 (8)0.525 (10)0.587 (7)
10
39fmplaza101/22/18Sistemas Inteligentes de Acceso a la Información (SINAI)0.342 (39)
0.263 (41)
0.361 (40)
0.444 (39)
0.300 (40)
0.160 (41)0.062 (44)0.173 (41)0.278 (39)0.125 (42)12ChuhanWu801/20/18THU_NGN0.722 (12)0.734 (12)0.710 (12)0.743 (7)0.700 (14)0.563 (7)0.647 (5)0.503 (11)0.553 (5)0.547 (18)
11
40NAVEEN.J.R802/08/18CENNLP0.328 (40)
0.315 (40)
0.415 (39)
0.178 (40)
0.404 (39)
0.280 (39)0.231 (40)0.284 (37)0.259 (40)0.344 (39)13danielfl602/08/18Amobee0.721 (13)0.748 (10)0.670 (21)0.748 (6)0.721 (10)0.512 (21)0.528 (25)0.462 (21)0.528 (9)0.531 (21)
12
41phejimlin201/08/180.270 (41)
0.516 (36)
0.224 (41)
0.060 (44)
0.281 (41)
0.123 (42)0.354 (38)-0.010 (45)-0.103 (47)0.249 (41)14gupta-rk301/27/18CrystalFeel0.717 (14)0.740 (11)0.700 (13)0.708 (14)0.720 (11)0.531 (17)0.586 (16)0.460 (22)0.491 (14)0.588 (6)
13
42Amrita_student602/08/180.200 (42)
0.216 (42)
0.210 (42)
0.112 (42)
0.262 (42)
0.211 (40)0.191 (41)0.207 (40)0.190 (41)0.256 (40)15jogonba2402/08/18ELiRF-UPV0.696 (15)0.705 (18)0.686 (18)0.693 (18)0.700 (13)0.541 (12)0.593 (15)0.533 (5)0.456 (24)0.582 (9)
14
43Amrita_student1101/28/18hjpwhu0.125 (43)
0.112 (43)
0.096 (43)
0.127 (41)
0.165 (43)
0.103 (44)0.153 (42)0.087 (42)0.052 (43)0.122 (43)16lanman401/24/18ECNU0.695 (16)0.713 (16)0.677 (19)0.693 (17)0.697 (16)0.514 (20)0.553 (21)0.455 (23)0.490 (15)0.558 (15)
15
44anongeorge801/28/18TeamCEN0.077 (44)
0.062 (44)
0.076 (44)
0.079 (43)
0.090 (44)
0.121 (43)0.127 (43)0.076 (43)0.172 (42)0.111 (44)17Malak601/28/18UNCC0.695 (17)0.722 (14)0.692 (15)0.698 (15)0.666 (20)0.536 (14)0.607 (13)0.494 (14)0.478 (18)0.562 (14)
16
45dragoni602/13/18NEUROSENT-PDI0.025 (45)
0.022 (45)
0.029 (45)
0.000 (45)
0.049 (45)
0.015 (45)0.060 (45)-0.034 (47)0.000 (44)0.033 (46)18homaralex101/08/18rakowski0.692 (18)0.712 (17)0.691 (16)0.694 (16)0.672 (17)0.539 (13)0.617 (8)0.486 (17)0.496 (13)0.555 (17)
17
46Random_Baseline201/10/18AIT2018 Organizers-0.008 (46)
-0.018 (46)
0.024 (46)
-0.058 (47)
0.020 (46)
-0.048 (47)-0.088 (47)-0.011 (46)-0.032 (46)-0.059 (47)19CZWin32768201/24/18Zewen0.682 (19)0.673 (20)0.700 (14)0.690 (19)0.665 (21)0.533 (15)0.571 (17)0.524 (7)0.480 (17)0.557 (16)
18
47AlexandraFlescan802/08/18TweetGroup-0.016 (47)
-0.043 (47)
0.003 (47)
-0.011 (46)
-0.014 (47)
0.014 (46-0.050 (46)0.073 (44)-0.003 (45)0.036 (45)20lyb3b101/27/18ZMU0.668 (20)0.661 (24)0.688 (17)0.666 (23)0.659 (22)0.498 (22)0.536 (23)0.492 (15)0.442 (27)0.524 (22)
19
21velango501/27/18BML0.666 (21)0.695 (19)0.659 (23)0.638 (27)0.672 (18)0.521 (18)0.569 (18)0.452 (24)0.485 (16)0.579 (10)
20
Late Submissions22yoyo301/24/18YNU-HPCC0.657 (22)0.626 (30)0.663 (22)0.668 (22)0.671 (19)0.520 (19)0.564 (20)0.478 (19)0.500 (12)0.538 (20)
21
ruwanw202/08/18zealots0.6290.6470.620.6180.6290.4750.5390.4490.4090.50223dmikrav902/13/18Dmitry and Lidia0.653 (23)0.654 (25)0.672 (20)0.648 (26)0.635 (24)0.490 (24)0.526 (26)0.497 (13)0.420 (30)0.517 (24)
22
bicici602/10/18RTM0.1660.1040.0630.2660.2330.130.0840.0670.1320.23724mooshow101/27/180.648 (24)0.667 (22)0.637 (28)0.669 (21)0.618 (29)0.491 (23)0.568 (19)0.439 (26)0.478 (19)0.477 (29)
23
25abhisheknkar201/28/18chambana0.647 (25)0.663 (23)0.646 (24)0.649 (25)0.628 (27)0.463 (29)0.514 (27)0.431 (28)0.422 (29)0.485 (27)
24
26sabino101/23/18INGEOTEC0.644 (26)0.643 (26)0.621 (29)0.684 (20)0.626 (28)0.459 (30)0.485 (31)0.412 (30)0.465 (21)0.475 (30)
25
27pribanp401/26/18UWB0.642 (27)0.640 (27)0.642 (27)0.652 (24)0.636 (23)0.478 (25)0.503 (29)0.433 (27)0.457 (23)0.517 (23)
26
28ISCLAB901/25/18ISCLAB0.636 (28)0.672 (21)0.643 (26)0.594 (32)0.634 (25)0.467 (27)0.551 (22)0.449 (25)0.399 (33)0.468 (31)
27
29bhaskar121101/27/18iit_delhi0.621 (29)0.633 (28)0.645 (25)0.618 (28)0.588 (31)0.469 (26)0.503 (30)0.483 (18)0.408 (32)0.483 (28)
28
30kdeaffect301/26/18KDE-AFFECT0.620 (30)0.630 (29)0.621 (30)0.598 (30)0.630 (26)0.463 (28)0.528 (24)0.412 (29)0.415 (31)0.499 (26)
29
31Habibeh401/28/18DeepMiner0.575 (31)0.581 (31)0.570 (32)0.575 (33)0.573 (32)0.456 (31)0.512 (28)0.376 (32)0.432 (28)0.503 (25)
30
32kiksekage301/22/18KU_MTL0.557 (32)0.521 (35)0.606 (31)0.538 (36)0.563 (33)0.383 (36)0.385 (37)0.377 (31)0.341 (38)0.429 (34)
31
Dataset01/28/18
DaPTaMiningTeam
0.552 (33)0.552 (32)0.539 (34)0.560 (35)0.555 (34)0.399 (32)0.469 (32)0.306 (35)0.395 (34)0.425 (35)
32
IsearIsear01/23/18ITU-BOUN0.544 (34)0.489 (39)0.490 (37)0.598 (29)0.597 (30)0.346 (38)0.327 (39)0.254 (39)0.343 (37)0.459 (32)
33
DatasetNum SamplesAvg Num WordsNum Samples01/28/18LTL Uni-Due0.536 (35)0.538 (33)0.500 (36)0.596 (31)0.510 (35)0.395 (34)0.418 (35)0.272 (38)0.455 (25)0.435 (33)
34
IsearIsearEmotion36CYYWJ101/28/180.522 (36)0.511 (37)0.548 (33)0.534 (37)0.495 (36)0.392 (35)0.421 (34)0.357 (33)0.376 (36)0.412 (36)
35
Num Samples
Avg Num Words
Num Samples
37SVM_Unigrams_Baseline101/31/18
AIT2018 Organizers
0.520 (37)0.526 (34)0.525 (35)0.575 (34)0.453 (38)0.396 (33)0.455 (33)0.302 (36)0.476 (20)0.350 (38)
36
Emotion
37
38
39
Dataset
40
IsearIsear
41
Num SamplesAvg Num WordsNum Samples
42
Emotion
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100