ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
Question IDSession IDIssueAction
2
118b22295cd6ab1bambiguous referencesession removed
ambiguous reference - scenarios similar to the question; might affect retrieval evaluation
3
ad7109d126a0ee23answer interferencesession removed
info leak (no conflict) - affects retrieval evaluation but not the answer's correctness
4
c8c3f81d 19ec83c5_1info leak (no conflict)session removed
answer interference - answer probably changed by filler sessions by mistake
5
0862e8bf8f532b13_1info leak (no conflict)session removed
6
6d550036e255d6fc_2answer interferencesession removed
7
gpt4_d12ceb0e157dc93danswer interferencesession removed
8
60472f9ca8fc1154_3answer interferencesession removed
9
60472f9c541ecc45_1answer interferencesession removed
10
1c0ddc502aa70c9c_1info leak (no conflict)no action
11
4f54b7c9f508f11f_2answer interferencesession removed
12
5025383bd4230511_4answer interferencesession removed
13
gpt4_7abb270c253742b4_1answer interferencesession removed
14
2ebe6c904e9524c7_4answer interferencesession removed
15
370a8ff43fe482adambiguous referencesession removed
16
gpt4_d6585ce8c2e2d770answer interferencesession removed
17
gpt4_d31cdae31dbe5e0c_2answer interferencesession removed
18
9ea5eabc 6e2cca63_1ambiguous referenceno action
19
41698283431ae25cinfo leak (no conflict)no action
20
a2f3aa27eb30ba3d_1ambiguous referencesession removed
21
dad224aa 6de8645d_1info leak (no conflict)session removed
22
2133c1b5_absa864e7aa_5ambiguous referenceno action
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100