GPT-4 turbo speed

	A	B	C	E	F	G	I
1	Tokens/second	Duration (ms)	Token output	Tokens/second	Duration (ms)	Token output
2	GPT-4 Turbo			GPT-4			Run Idx
3	24.78	28775	713	14.07	42492	598	1
4	24.06	32955	793	19.41	19882	386	2
5	27.19	28903	786	18.17	28182	512	3
6	24.21	31314	758	10.89	46375	505	4
7	24.63	32808	808	19.17	24671	473	5
8	29.16	33399	974	12.33	50854	627	6
9	28.76	39668	1141	18.94	37277	706	7
10	23.84	48022	1145	10.11	81126	820	8
11	14.56	74811	1089	10.30	65520	675	9
12	27.31	45840	1252	10.69	78780	842	10
13	28.86	37216	1074	18.80	47232	888	11
14	16.39	69555	1140	11.89	100806	1199	12
15	24.41	49898	1218	10.43	107820	1125	13
16	26.85	46101	1238	10.85	101910	1106	14
17	29.79	45626	1359	11.31	29003	328	15
18	31.54	44733	1411	11.31	100097	1132	16
19	30.06	49898	1500	10.25	127847	1311	17
20	32.62	40374	1317	10.06	126095	1268	18
21	28.76	49505	1424	11.49	37003	425	19
22	26.92	54127	1457	12.21	107099	1308	20
23	20.62	23665	488	21.31	68094	1451	21
24	21.15	44918	950	12.34	41410	511	22
25	25.29	42192	1067	12.61	72097	909	23
26	30.56	28207	862	13.18	41270	544	24
27	26.56	29631	787	11.60	59920	695	25
28	28.43	35351	1005	11.14	78928	879	26
29	25.08	47607	1194	12.38	61308	759	27
30	27.19	44947	1222	17.77	53283	947	28
31	24.38	56487	1377	10.52	116052	1221	29
32
33	Average			Average
34	26.00			13.29
35
36	GPT-4 Turbo is
37	1.96x faster
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100