GPU Cloud comparisons

	A	B	C	D	E	F	G	H	I	J	K	L	M	N	O
1			#	VRAM	Float16 TFLOPs	Float8 TFLOPs	Band Width	W Per Card	Price	Per GPU	Per fp16 PFLOP	Per fp8 PFLOP	BF16	Supply	Info
2

3	Kaggle	Tesla T4	1	16	65		900	70	0	0	0.000		N	5	https://www.nvidia.com/en-au/data-center/tesla-t4/
4	Lambda	A6000 Ada	4	48	364.25	728.5	960	300	3.2	0.8	2.196	1.098	Y	1	https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/rtx-6000/proviz-print-rtx6000-datasheet-web-2504660.pdf
5	Lambda	H100 PCIe	1	80	989	1979	2000	350	2.49	2.49	2.518	1.258	Y	1	https://www.nvidia.com/en-au/data-center/h100/
6	Colab	Tesla T4	1	16	65		900	70	0.184		2.831		N	5	https://www.nvidia.com/en-au/data-center/tesla-t4/
7	Runpod	A6000 Ada	8	48	364.25	728.5	960	300	9.12	1.14	3.130	1.565	Y	2	https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/rtx-6000/proviz-print-rtx6000-datasheet-web-2504660.pdf
8	Lambda	H100 SXM	8	80	989	1979	3350	700	27.92	3.49	0.184	1.764	Y	0	https://www.nvidia.com/en-au/data-center/h100/
9	Runpod	L4	8	24	121	242.5	300	72	3.52	0.44	3.636	1.814	Y	0	https://www.nvidia.com/en-au/data-center/l4/
10	Colab	A100	1	40	312		1555	250	1.177	1.177	3.772		Y	2	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
11	Runpod	RTX A4500	4	20	94.6		640	200	1.44	0.36	3.805		Y	2	https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/rtx/nvidia-rtx-a4500-datasheet.pdf
12	Runpod	H100 PCIe	8	80	989	1979	3350	700	31.12	3.89	3.933	1.966	Y	3	https://www.nvidia.com/en-au/data-center/h100/
13	Runpod	RTX A5000	8	24	111.1		768	230	3.52	0.44	3.960		Y	3	https://nvdam.widen.net/s/wrqrqt75vh/nvidia-rtx-a5000-datasheet
14	Colab	L4	1	24	121	242.5	300	72	0.482	0.482	3.983	1.988	Y	4	https://www.nvidia.com/en-au/data-center/l4/
15	Runpod	L40S	8	48	362.05	733	864	350	11.92	1.49	4.115	2.033	Y	2	https://www.nvidia.com/en-au/data-center/l40s/
16	Lambda	A100 PCIe	4	40	312		1555	250	5.16	1.29	4.135		Y	0	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
17	Colab	V100	1	16	112		900	300	0.482	0.482	4.304		N	5	https://www.nvidia.com/en-au/data-center/v100/
18	Runpod	RTX A4000	8	16	76.7		448	140	2.72	0.34	4.433		Y	2	https://www.nvidia.com/content/dam/en-zz/Solutions/gtcs21/rtx-a4000/nvidia-rtx-a4000-datasheet.pdf
19	Runpod	RTX 4090	8	24	165.2	330.3	1008	450	5.92	0.74	4.479	2.240	Y	3	https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf
20	Runpod	A40	8	48	149.7		696	300	5.52	0.69	4.609		Y	3	https://images.nvidia.com/content/Solutions/data-center/a40/nvidia-a40-datasheet.pdf
21	Runpod	H100 SXM	8	80	989	1979	3350	700	37.52	4.69	4.742	2.370	Y	3	https://www.nvidia.com/en-au/data-center/h100/
22	Runpod	A4000 Ada	4	20	82	163.8	360	130	1.56	0.39	4.756	2.381	Y	2	https://resources.nvidia.com/en-us-design-viz-stories-ep/rtx-4000-ada-datashe?lx=CCKW39&contentType=data-sheet
23	Lambda	V100	8	16	112		900	300	4.4	0.55	4.911		N	1	https://www.nvidia.com/en-au/data-center/v100/
24	Runpod	RTX A6000	8	48	154.85		768	300	6.32	0.79	5.102		Y	3	https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/quadro-product-literature/proviz-print-nvidia-rtx-a6000-datasheet-us-nvidia-1454980-r9-web%20(1).pdf
25	Google	Tesla T4	4	16	65		900	70	1.4	0.35	5.385		N	5	https://www.nvidia.com/en-au/data-center/tesla-t4/
26	Lambda	A100 SXM	8	80	312		2039	400	14.32	1.79	5.737		Y	0	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
27	Lambda	A10	1	24	125	250	600	150	0.75	0.75	6.000	3.000	Y	3	https://www.nvidia.com/en-au/data-center/products/a10-gpu/
28	Runpod	A100 PCIe	8	80	312		1555	250	15.12	1.89	6.058		Y	3	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
29	Runpod	RTX 3090	8	24	71		936	350	3.52	0.44	6.197		Y	1	https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf
30	Runpod	L40	8	48	181.05	362	864	300	9.12	1.14	6.297	3.149	Y	2	https://images.nvidia.com/content/Solutions/data-center/vgpu-L40-datasheet.pdf
31	Runpod	A100 SXM	8	80	312		2039	400	18.32	2.29	7.340		Y	2	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
32	Google	L4	8	24	121	242.5	300	72	8.003331	1.000416375	8.268	4.125	Y	4	https://www.nvidia.com/en-au/data-center/l4/
33	Google	A100 PCIe	8	40	312		1555	250	29.387816	3.673477	11.774		Y	4	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
34	AWS	A100 PCIe	8	40	312		1555	250	32.77	4.09625	13.129		Y	4	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
35	AWS	Tesla T4	8	16	65		320	70	7.824	0.978	15.046		N	5	https://www.nvidia.com/en-au/data-center/tesla-t4/
36	Google	A100 SXM	8	80	312		2039	400	40.5504	5.0688	16.246		Y	4	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
37	AWS	A100 SXM	8	80	312		2039	400	40.96	5.12	16.410		Y	4	https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf
38	Google	V100	8	16	112		900	300	19.84	2.48	22.143		N	5	https://www.nvidia.com/en-au/data-center/v100/
39	AWS	V100	8	16	112		900	300	24.48	3.06	27.321		N	5	https://www.nvidia.com/en-au/data-center/v100/
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100