Geoparsing Bake-off Results
Comments
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
Comment only
 
 
Still loading...
ABCDEFGHIJKLMNOPQRSTUVWXY
1
NYT BBCHuffPo
2
RECALL: Accuracy at picking up place mentions from unstructured textPRECISION: % relevant place mentionsAccuracy at Disambiguating placesABOUTNESS: Frequency of place mention corresponds to "real country"F1 measureRECALL: Accuracy at picking up place mentions from unstructured textPRECISION: % relevant place mentionsAccuracy at Disambiguating placesFrequency of place mention corresponds to "real country"F1 measureRECALL: Accuracy at picking up place mentions from unstructured textPRECISION: % relevant place mentions Accuracy at Disambiguating placesFrequency of place mention corresponds to "real country"F1 measure
3
Yahoo Placespotter76.58%90.22%95.73%80.77%0.8370.27%92.31%98.08%52.38%0.8061.64%80.56%95%73.91%0.70Yahoo Placespotter
4
OpenCalais43.51%100%87.44%43.48%0.6158.22%98.82%94.12%72.73%0.7362.54%91.52%89.27%62.5%0.74OpenCalais
5
CLAVIN63%96.19%86.35%84.62%0.7665.31%92.7%90.63%64%0.7763.03%93.86%92.74%77.27%0.75CLAVIN
6
7
8
Agreement on place mentionsAgreement on "real country"Agreement on place mentionsAgreement on "real country"Agreement on place mentionsAgreement on "real country"
9
Humans88.61%88.46%97.35%100%90.73%100%
10
11
HUMAN AGREEMENT AVERAGES
12
Average human agreement on place mention92.23%
13
Average human agreement on aboutness of article96.15%
14
15
GEOPARSING AVERAGES
16
RECALL: Accuracy at picking up place mentions from unstructured textPRECISION: % relevant place mentionsAccuracy at Disambiguating placesABOUTNESS: Frequency of place mention corresponds to "real country"F1 measure
17
Yahoo Placespotter69.50%87.70%96.27%69.02%0.78
18
OpenCalais53.03%96.78%90.28%59.57%0.69
19
CLAVIN63.78%94.25%89.91%75.30%0.76
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...
 
 
 
Sheet1