SereTOD Challenge Evaluation Results

	A	B	C	D	E	F	G	H	I	J	K	L	M	N
1		Track1			Track2
2					Automatic Evaluation					Human Evaluation				Final score
3	Team ID	Entity F1	Triple F1	Average	User intent F1	System intent F1	BLEU	Success	Combined	Fluency	Coherency	Success	Average	Final score
4	1	60.73	56	58.37
5	2	54.27	43.27	48.77	0.656	0.533	3.821	0.259	1.524	2.87	2.55	2.42	2.61	2.07
6	3	56.47	55.96	56.22
7	4	51.37	47.15	49.26
8	5	47.08	41.86	44.47	0.714	0.589	6.79	0.432	1.871	4.06	3.14	3.4	3.53	2.70
9	6	51.73	42.79	47.26
10	7	42.28	22.14	32.21
11	8				0.699	0.55	6.44	0.644	2.022	2.39	2.29	2.03	2.24	2.13
12	9	42.87	40.28	41.58
13	10	44.7	39.66	42.18	0.664	0.504	3.629	0.217	1.458	3.2	2.98	3.11	3.1	2.28
14	11	33.82	35.67	34.75	0.728	0.595	14.43	0.78	2.392	4.23	3.73	3.47	3.81	3.10
15	12	55.17	56.07	55.62
16	13				0.706	0.587	5.526	0.251	1.655	3.55	3.03	2.77	3.12	2.39
17	14	38.43	35.77	37.10
18	15	49.73	41.66	45.70
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100