ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJAKALAMANAOAPAQARASATAUAVAWAXAYAZBABB
1
Train: 10 examples per class in en-US
2
3
Cohere multilingual-22-12en-USAvg (non English)af-ZAam-ETar-SAaz-AZbn-BDca-EScy-GBda-DKde-DEel-GRes-ESfa-IRfi-FIfr-FRhe-ILhi-INhu-HUhy-AMid-IDis-ISit-ITja-JPjv-IDka-GEkm-KHkn-INko-KRlv-LVml-INmn-MNms-MYmy-MMnb-NOnl-NLpl-PLpt-PTro-ROru-RUsl-SLsq-ALsv-SEsw-KEta-INte-INth-THtl-PHtr-TRur-PKvi-VNzh-CNzh-TW
4
Nearest Neighbor (cosine)51.342.945.440.634.841.244.440.835.147.345.641.642.245.445.747.340.345.544.240.547.240.244.245.932.934.832.443.544.744.145.341.943.941.746.748.446.045.145.646.044.943.648.635.943.245.140.040.044.440.143.546.243.1
5
Nearest Neighbor (dot product)58.151.352.548.545.050.251.551.945.555.252.852.052.055.552.055.250.352.952.148.554.349.954.053.543.942.142.752.454.049.951.751.552.949.154.555.253.153.453.152.853.251.355.945.550.052.948.451.253.850.749.754.351.1
6
Nearest Neighbor (euclidean)50.341.443.839.333.539.642.738.733.646.243.439.941.043.344.145.938.644.243.239.346.438.842.643.931.533.231.342.043.242.743.740.842.140.145.147.244.343.343.844.843.242.547.134.241.643.438.738.642.537.942.045.142.1
7
Nearest Centroid (cosine)72.963.664.759.553.763.062.865.155.569.065.563.166.768.567.269.161.566.665.661.868.962.367.567.053.350.252.863.063.864.362.762.666.059.068.869.268.166.466.967.166.062.570.155.760.565.658.064.166.062.861.969.364.1
8
Nearest Centroid (dot product)57.849.850.647.842.547.450.748.143.153.951.748.850.053.652.252.449.252.451.246.752.746.952.453.842.640.340.250.653.350.250.350.550.447.552.654.451.851.450.652.150.848.554.043.048.752.647.250.350.950.548.454.751.6
9
Nearest Centroid (euclidean)73.163.864.859.753.663.362.665.355.669.265.763.166.968.667.569.461.766.865.861.969.162.567.767.253.450.152.663.363.864.363.062.466.659.169.069.668.366.766.867.366.362.770.255.860.665.458.064.366.362.861.969.364.2
10
Logistic Regression Classifier73.562.764.959.252.362.262.462.655.668.465.663.065.967.065.768.559.865.865.860.267.161.365.165.053.450.151.761.763.063.662.061.564.858.167.869.265.965.765.665.665.562.969.456.659.064.157.363.464.661.659.667.363.0
11
12
13
Sentence-Transformers (paraphrase-multilingual-mpnet-base-v2)
en-USAvg (non English)af-ZAam-ETar-SAaz-AZbn-BDca-EScy-GBda-DKde-DEel-GRes-ESfa-IRfi-FIfr-FRhe-ILhi-INhu-HUhy-AMid-IDis-ISit-ITja-JPjv-IDka-GEkm-KHkn-INko-KRlv-LVml-INmn-MNms-MYmy-MMnb-NOnl-NLpl-PLpt-PTro-ROru-RUsl-SLsq-ALsv-SEsw-KEta-INte-INth-THtl-PHtr-TRur-PKvi-VNzh-CNzh-TW
14
Nearest Neighbor (cosine)59.846.443.729.043.841.140.051.514.653.650.753.455.553.251.455.249.253.456.646.554.927.953.752.427.341.634.338.752.350.643.744.351.444.953.854.554.555.353.353.152.853.055.310.839.639.350.125.253.246.649.853.151.3
15
Nearest Neighbor (dot product)59.545.342.729.041.939.038.851.114.552.250.251.354.352.550.454.047.452.055.544.854.127.452.252.027.040.634.037.049.549.741.742.749.844.053.353.453.054.152.152.351.951.354.012.138.138.749.226.252.245.348.551.949.9
16
Nearest Neighbor (euclidean)59.739.334.217.735.032.229.946.37.649.842.946.351.450.044.449.343.147.852.233.851.716.348.842.917.732.424.330.445.543.835.132.247.141.449.351.246.351.248.042.047.248.450.25.429.829.541.115.949.042.445.646.844.0
17
Nearest Centroid (cosine)69.353.950.135.250.648.246.259.719.661.057.859.963.362.260.064.456.661.864.152.963.333.362.460.534.347.041.347.258.558.349.750.859.551.161.863.762.363.062.060.860.959.963.617.546.148.757.832.962.654.757.761.959.1
18
Nearest Centroid (dot product)55.642.837.828.639.838.536.947.512.850.046.647.050.750.346.850.945.949.551.241.250.724.750.249.325.837.031.937.748.046.639.840.546.743.049.951.249.450.849.148.248.148.450.811.536.338.446.724.850.342.746.548.746.4
19
Nearest Centroid (euclidean)72.151.544.030.747.144.641.559.116.660.654.357.563.362.457.263.054.061.563.447.762.925.562.156.730.342.335.642.957.355.746.646.259.051.861.063.460.363.061.256.760.660.363.313.042.243.954.828.261.753.457.060.958.1
20
Logistic Regression Classifier72.054.449.432.250.648.546.061.517.863.258.961.166.063.860.965.457.163.266.553.264.931.063.660.332.945.839.545.560.059.150.250.660.852.664.264.764.265.363.761.462.561.565.714.545.747.758.830.465.156.357.963.760.8
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100