Specifications

	A	B	D
1
2	Global parameters
3	Number of experimental conditions	5	4 submitted systems + the unprocessed condition
4	Number of stimuli per experimental condition	128	Stimuli are taken from CHiME-5
5	Stimulus approximate duration in seconds	5
6	Time to rate each stimulus in seconds	5
7	Target number of votes per stimulus and per rating scale	8
8	Number of rating scales	3	SIG, BAK, OVRL
9	Total number of participants	32	4 panels of 8 listeners
10
11	Split into smaller tests
12	Number of tests	4
13	Number of stimuli per experimental condition in each test	32
14	Number of participants in each test	8
15	Total number of test conditions in each test	160	Number of stimuli per experimental condition in each test x Number of experimental conditions. Each test condition is a triad of samples.
16	Duration of the test (in minutes)	80	We will ask participants to listen only once to each sample, some time for thinking/clicking should be taken into account.
17	Number of listening sessions / presentation sets	4
18	Duration of a listening session (in minutes)	20	Participants will have a 5-min break between different listening sessions
19
20	Anchoring phase
21	Number of reference conditions	12	Different levels of SNR and distortion
22	Number of stimuli per reference condition	4	2 male and 2 female speakers
23	Stimulus approximate duration in seconds	4
24	Time to rate each stimulus in seconds	5
25	Duration of the anchoring phase (in minutes)	21,6	To be done at the beginning of each test.
26
27
28	Break duration (in minutes)	5
29	Total duration (in minutes)	116,6
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100