Haystack Eval Benchmark times

	B	C	D	E	G	H	I	J	K	L	M	O	P
1
2	Indexing				RAG and Evaluation pipeline times
3
4	embeding_model	chunk_size	time (seconds)	time (min.)	embeding_model	chunk_size	top_k	RAG (seconds)	Evaluation (seconds)	RAG (minutes)	Evaluation (minutes)	Total	Total w/ Indexing
5
6	all-MiniLM-L6-v2	64	23.3879	00:00:23	all-MiniLM-L6-v2	64	1	115.0065	315.9625	00:01:55	00:05:15	00:07:10	00:07:33
7	all-MiniLM-L6-v2	128	16.7725	00:00:16			2	147.3299	397.3388	00:02:27	00:06:37	00:09:04	00:09:27
8	all-MiniLM-L6-v2	256	14.0144	00:00:14			3	155.9973	438.8168	00:02:35	00:07:18	00:09:53	00:10:16
9	msmarco-distilroberta-base-v2	64	36.6414	00:00:36	all-MiniLM-L6-v2	128	1	127.4704	403.3983	00:02:07	00:06:43	00:08:50	00:09:06
10	msmarco-distilroberta-base-v2	128	28.5928	00:00:28			2	165.6365	495.9479	00:02:45	00:08:15	00:11:00	00:11:16
11	msmarco-distilroberta-base-v2	256	22.7719	00:00:22			3	175.42	486.2844	00:02:55	00:08:06	00:11:01	00:11:17
12	all-mpnet-base-v2	64	60.0775	00:01:00	all-MiniLM-L6-v2	256	1	157.1702	447.0828	00:02:37	00:07:27	00:10:04	00:10:18
13	all-mpnet-base-v2	128	60.1837	00:01:00			2	181.2393	540.9429	00:03:01	00:09:00	00:12:01	00:12:15
14	all-mpnet-base-v2	256	33.1369	00:00:33			3	193.5456	608.0195	00:03:13	00:10:08	00:13:21	00:13:35
15					msmarco-distilroberta-base-v2	64	1	129.2953	342.0623	00:02:09	00:05:42	00:07:51	00:08:27
16							2	147.8331	430.0561	00:02:27	00:07:10	00:09:37	00:10:13
17							3	160.8634	477.4629	00:02:40	00:07:57	00:10:37	00:11:13
18					msmarco-distilroberta-base-v2	128	1	153.5109	447.5886	00:02:33	00:07:27	00:10:00	00:10:28
19							2	179.9431	552.8577	00:02:59	00:09:12	00:12:11	00:12:39
20							3	205.2158	537.9969	00:03:25	00:08:57	00:12:22	00:12:50
21					msmarco-distilroberta-base-v2	256	1	182.3774	544.4505	00:03:02	00:09:04	00:12:06	00:12:28
22							2	197.1914	606.581	00:03:17	00:10:06	00:13:23	00:13:45
23							3	212.8711	669.8011	00:03:32	00:11:09	00:14:41	00:15:03
24					all-mpnet-base-v2	64	1	132.3261	362.8426	00:02:12	00:06:02	00:08:14	00:09:14
25							2	160.5959	486.2524	00:02:40	00:08:06	00:10:46	00:11:08
26							3	184.6738	541.4629	00:03:04	00:09:01	00:12:05	00:12:27
27					all-mpnet-base-v2	128	1	160.0306	471.3811	00:02:40	00:07:51	00:10:31	00:11:31
28							2	193.8441	585.5008	00:03:13	00:09:45	00:12:58	00:13:58
29							3	216.95	635.0051	00:03:36	00:10:35	00:14:11	00:15:11
30					all-mpnet-base-v2	256	1	185.9622	562.9571	00:03:05	00:09:22	00:12:27	00:13:00
31							2	214.15	663.0057	00:03:34	00:11:03	00:14:37	00:15:10
32							3	231.9518	717.3625	00:03:51	00:11:57	00:15:48	00:16:21
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100