DSTC 3 Results - Featured Metrics
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
View only
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZAAAB
1
Bold denotes best result in column, (over all systems irrespective of what inputs they take). L2 metric is lower the better. ROC metric is only comparable between systems of similar accuracy, in which case the higher is better.
2
3
Tracker Inputs
Joint GoalsMethodRequested
4
TeamEntrySLUASRAccL2ROCAccL2ROCAccL2ROC
5
0 (baselines)0 - top hyp0.5550.8600.0000.9220.1540.0000.7780.3930.000
6
1 - focus0.5560.7500.0000.9080.1340.0000.7610.4350.000
7
2 - HWU0.5750.7440.0000.9660.0670.0000.6980.5620.000
8
3 - Original HWU
0.5670.6910.0000.9670.0620.0000.7670.4170.000
9
100.5610.7610.0000.9620.0770.0000.7780.3930.000
10
10.5610.7610.0000.9620.0770.0000.7780.3930.000
11
20.5590.7360.0000.9630.0970.0000.7740.4010.000
12
30.5610.7330.0000.9630.0970.0000.7740.4010.000
13
200.5850.6970.0000.9650.1140.1710.9290.1210.061
14
10.5290.7410.0000.9240.1230.2790.9310.1220.106
15
20.5550.6770.1580.9500.0880.2470.9380.1050.062
16
30.5820.6390.1480.9700.0650.1410.9380.1380.369
17
40.5740.6500.1520.9660.0730.1620.9390.1110.387
18
300.6460.5380.1690.9660.0610.4340.9430.0910.441
19
10.6450.5340.1720.9660.0610.4340.9430.0910.441
20
20.6160.5650.1790.9660.0610.4000.9390.1000.309
21
30.6150.5640.1900.9660.0610.4000.9390.1000.309
22
400.6300.6270.0720.8530.2720.2550.9230.1360.355
23
10.6300.6270.0720.8530.2720.2550.9230.1360.355
24
20.6300.6270.0720.8530.2720.2550.9230.1360.355
25
30.6300.6270.0720.8530.2720.2550.9230.1360.355
26
500.6100.5560.2580.9680.0910.2580.9450.0900.471
27
10.5870.6340.1810.9580.0680.4430.9440.0960.000
28
20.5880.6390.1600.9610.0630.2720.9490.0900.000
29
600.5070.7360.1100.9270.1200.1980.9080.1570.192
30
10.5070.7390.1090.9270.1220.2200.9090.1560.190
31
20.5030.7430.1110.9270.1200.1980.9080.1570.192
32
30.5030.7460.1100.9270.1220.2180.9090.1560.190
33
700.5720.6770.0800.9560.1130.0480.9330.1040.463
34
10.5760.6520.0550.9570.1160.1540.9380.1010.448
35
20.5750.6670.0630.9340.1300.1830.9290.1070.470
36
30.5700.6580.0840.9570.1160.1540.9380.1010.448
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...
 
 
 
Sheet1