Graphics cards GPU comparison


1		ARCH	COMPUTE CAP	VRAM	MEM PF	MEM SP	MHZ	CUDAs	MHZ x CUDAs	FP32 TFLOPS	TCORES	PERF AGG	ENERGY	ENPRICE	PPRICE	TPRICE	BANG4BUCK

2	RTX 3080	Ampere	8.6	10	0.96	760	1440	8704	1203.24	29.77	272	2.4	320	€640	€350	€350	€149	100%
3	RTX 3060 Ti	Ampere	8.6	8	0.92	448	1410	4864	630.96	16.2	152	1.3	200	€400	€250	€250	€195	76%
4	RTX 4090	Ada Lovelace	8.9	24	1.24	1008	2235	16384	4540.66	82.6	512	6.4	450	€900	€1,500	€1,500	€235	63%
5	RTX 3070 Ti	Ampere	8.6	8	0.92	608	1575	6144	890.27	21.75	192	1.7	290	€580	€400	€400	€235	63%
6	RTX 4070 Ti	Ada Lovelace	8.9	12	1	504	2310	7680	1774.08	40.1	240	2.8	285	€570	€700	€700	€248	60%
7	RTX 3080 Ti	Ampere	8.6	12	1	912	1365	10240	1397.76	34.1	320	2.7	350	€700	€700	€700	€256	58%
8	RTX 4070 Ti Super	Ada Lovelace	8.9	16	1.08	672	2340	8448	2134.98	44.1	264	3.2	285	€570	€900	€900	€280	53%
9	RTX 4080	Ada Lovelace	8.9	16	1.08	716	2205	9728	2316.63	48.7	304	3.6	320	€640	€1,000	€1,000	€280	53%
10	RTX 4070 Super	Ada Lovelace	8.9	12	1	504	1980	7168	1419.26	35.5	224	2.5	220	€440	€700	€700	€285	52%
11	RTX 4080 Super	Ada Lovelace	8.9	16	1.08	736	2295	10240	2538.09	52.2	320	3.8	320	€640	€1,100	€1,100	€287	52%
12	RTX 3090	Ampere	8.6	24	1.24	936	1395	10496	1815.60	35.58	328	3.0	350	€700	€900	€900	€296	50%
13	RTX 4070	Ada Lovelace	8.9	12	1	504	1920	5888	1130.50	29.2	184	2.0	285	€570	€600	€600	€300	49%
14	RTX 3090 Ti	Ampere	8.6	24	1.24	1008	1560	10752	2079.87	40	336	3.3	450	€900	€1,200	€1,200	€361	41%
15	RTX 3070	Ampere	8.6	8	0.92	448	1500	5888	812.54	20.31	184	1.6	220	€440	€600	€600	€376	40%
16	RTX A5000	Ampere	8.6	24	1.24	768	1170	8192	1188.50	27.8	256	2.2	230	€460	€1,500	€2,200	€669	22%
17	RTX A4000	Ampere	8.6	16	1.08	448	735	6144	487.71	19.1	192	1.4	140	€280	€1,000	€1,000	€709	21%
18	RTX 4000 Ada	Ada Lovelace	8.9	20	1.16	280	1290	6144	919.39	19.2	192	1.7	70	€140	€1,250	€1,250	€754	20%
19	L20	Ada Lovelace	8.9	48	1.72	864	1440	11776	2916.68	59.3	368	4.4	275	€550	€5,000	€5,000	€1,139	13%
20	RTX 6000 Ada	Ada Lovelace	8.9	48	1.72	960	915	18176	2860.54	91.1	568	5.8	300	€600	€7,000	€7,000	€1,201	12%
21	RTX 5000 Ada	Ada Lovelace	8.9	32	1.4	576	1150	12800	2060.80	65.2	400	4.2	250	€500	€5,000	€5,000	€1,203	12%
22	L4	Ada Lovelace	8.9	24	1.24	300	795	7680	757.09	31.3	240	2.0	285	€570	€2,500	€2,500	€1,232	12%
23	L40	Ada Lovelace	8.9	48	1.72	864	735	18176	2297.81	90.5	568	5.5	300	€600	€9,000	€9,000	€1,638	9%
24	RTX A6000	Ampere	8.6	48	1.72	768	1410	10752	2607.58	38.7	336	3.6	300	€600	€6,000	€6,000	€1,669	9%
25	A100	Ampere	8.0	40	1.56	1555	1410	6912	1520.36	19.5	432	2.8	250	€500	€16,000	€16,000	€5,646	3%
26	H100	Hopper	9.0	80	2.36	2039	1065	7296	1833.78	24.1	456	3.2	350	€700	€30,000	€30,000	€9,351	2%
27
28
29	Color-coding				Variables
30	Current Gen (Ada Lovelace)	Consumer	Workstation/server		Years of operation				0
31	Previous Gen (Ampere)	Consumer	Workstation/server		Performance degredation mem bus factor				0.02
32	Older Gen	Consumer	Workstation/server		Price per Watt per year				€2.00
33
34
35	Legend
36	ARCH	GPU Architecture
37	COMPUTE CAP	Compute Capability
38	VRAM	Video card memory capacity
39	MEM PF	Artificially calculated bottleneck factor for memory capacity; experimentally determined
40	MEM SP	Memory speed in GB/s
41	MHZ	Chip base clock speed
42	CUDAs	Number of CUDA cores
43	MHZ x CUDAs	Performance indicator 1: Base clock times the number of CUDA cores times MEM PF divided by 10000
44	FP32 TFLOPS	Performance inidcator 2: Single-precision floating point performance
45	TCORES	Number of Tensor Cores
46	PERG AGG	Aggregated performance: weighted average of performance indicator 1 and 2
47	ENERGY	Rated TDP as estimate of 100% load energy usage
48	ENPRICE	Estimated cost of 100% operation per year
49	PPRICE	Current new price or estimated second-hand price (in Europe)
50	TPRICE	PPRICE + ENPRICE times "Years of operation"
51	BANG4BUCK	TPRICE divided by PERF AGG