ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJAKALAMANAOAPAQARASATAUAVAWAXAYAZBABBBCBDBEBFBGBHBIBJBKBLBMBNBOBPBQBRBSBTBUBVBWBXBYBZCACBCCCDCECFCGCHCICJCKCLCMCNCOCPCQCRCSCTCUCV
1
Group IDMethodLate Submissionarbgcacsdadeelenesfafifrhehihuiditkonlnoplptrorusvthtrukvizh
2
ArabicBulgarian
Catalan, Valencian
CzechDanishGerman
Greek, Modern (1453-)
English
Spanish, Castilian
PersianFinnishFrenchHebrewHindiHungarianIndonesianItalianKoreanDutch, FlemishNorwegianPolishPortuguese
Romanian, Moldavian, Moldovan
RussianSwedishThaiTurkishUkrainianVietnameseChinese
3
FPTAIBERT73.2460243283.7721397852.5512637184.4696969782.2971048922.6231106884.3984962482.2349570280.6026365381.6968541583.6227123421.592574583.7888784276.4319248885.4554124981.9333646226.5495363683.6676217883.2855778480.5318138784.5341018383.2309872584.6044528784.0800762683.1824678481.2588069586.5045302883.1205673880.3435114581.24704771
4
LIATML-BERT63.1578947475.1992031976.2753838579.4642857174.801587379.4884407372.4308300478.5573122577.7283950675.4212091279.1274169676.8849206379.1066997516.4938271678.9291026372.4479682981.3575996180.3775459579.8621368876.5027322480.5970149378.4935579876.1668321779.0927021771.6343765549.5794161377.1895101478.7128712975.2357320177.96944308
5
PribLBERTGRU76.26613704----80.23656974-81.2717337380.2970297--77.93240557----81.9169960581.5146985680.95002474-82.7277252482.36462991-82.5979177--84.35643564--78.3810464
6
PribL
BERTLINCONCAT
75.45195052--81.191067-79.83074753-80.1175318380.71532141--78.52216749----81.8936066481.0361681381.2561334678.39046283.4630350281.88440991-83.07392996--83.22800194--79.37438905
7
RH312RnnGnnXlmr-82.13228036---------80.31418753-71.69995129-77.55501222---------76.7666989483.28445748---
8
ousia
RoBERTa+wiki2vec+wikidata
70.51909892----81.8627451--80.94302554--81.00890208-69.74708171--81.21330724----81.3976378---76.36363636---79.76424361
9
uomfjjointrep64.5481628683.0677290879.821517181.2903225880.5555555681.02513553-82.7317073281.3861386180.3766105180.9122459178.2081194681.0918114166.6666666785.0198412778.5111662582.0158102882.5112107681.6427511178.7878787984.5196615280.8743169480.8341608782.89538919-65.0173181684.8514851581.6063460677.0605759778.57847976
10
uomfj
jointrepPostprocess
64.5481628683.0677290879.821517181.2903225880.5555555681.02513553-82.5705939681.3861386180.3766105180.9122459178.2081194681.0918114166.6666666785.0198412778.5111662582.0158102882.5112107681.6427511178.7878787984.5196615280.8743169480.8341608782.89538919-65.0173181684.8514851581.6063460677.0605759778.57847976
11
uomfj
jointrepUnionPostprocess
64.5481628683.0677290879.821517181.2903225880.5555555681.02513553-82.6756496681.3861386180.3766105180.9122459178.2081194681.0918114166.6666666785.0198412778.5111662582.0158102882.5112107681.6427511178.7878787984.5196615280.8743169480.8341608782.89538919-65.0173181684.8514851581.6063460677.0605759778.57847976
12
FPTAIBERTY73.249884183.2780672781.1038353683.740601581.7366682481.2645281384.102564181.9563152980.6012212381.5201900283.3644859880.6786050984.2105263275.6529850784.782608781.6535067382.8073480983.7696335183.1749049480.1699716784.0703756582.7004219484.5972680283.4355828283.4361651681.1567164286.0255802982.6066572980.4182509580.59841047
13
HUKBABY30.9831181760.8565737142.3401090752.6054590649.0079365153.721044857.50988142345.1068057649.2079207945.5896927753.1482399643.8369781359.9503722139.703703769.146825444.0694789145.5533596863.6771300442.3552696734.575260862.7177700342.3248882357.5968222442.0426375850.3232222839.9802078261.8811881260.2875557860.3773584921.22408687
14
HUKBABCY30.9831181761.0557768942.538423452.6054590649.0079365153.819615577.50988142345.1068057649.1089108945.5896927753.4457114543.7375745560.0496277939.5061728469.4444444444.4665012445.5533596863.9760837142.4542305834.575260863.5141861642.6229508257.6961271142.2409519150.621581340.3760514662.4752475260.1883986160.4766633621.42152024
15
HUKBACY13.5054617728.087649416.2617749118.8585607913.9880952426.811237067.50988142311.9225037319.504950515.6590683817.0550322311.2326043715.7816377222.0246913626.0912698416.2779156312.0553359713.951170917.1202375111.3263785432.5535092116.0953800328.5004965211.3039167121.9791148724.0475012416.7326732722.5086762522.144985117.5715696
16
LIATML-BERTY------------------------79.58271237-----
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97