| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | AA | AB | AC | AD | AE | AF | AG | AH | AI | AJ | AK | AL | AM | AN | AO | AP | AQ | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Name of the hardware | Manufacturer | FP64 Performance (FLOP/s) | FP32 Performance (FLOP/s) | FP16 Performance (FLOP/s) | FP/TF32 Tensor Performance (FLOP/s) | FP16 Tensor Performance (FLOP/s) | FP8 Tensor Performance (FLOP/s) | INT16 Performance (OP/s) | INT8 Tensor Performance (OP/s) | INT4 Tensor Performance (OP/s) | Memory size per board (Byte) | Memory Bandwidth (Byte/s) | Arithmetic intensity (FLOP/Byte) | Type of interconnect (Bus Interface) | interconnect speed (in GB/s, bidirectional) | Type of specialized point-to-point interconnect | Specialized point-to-point interconnect speed (in GB/s, bidirectional) | LambdaLabs FP32 ResNet-50 Pytorch Throughput (samples/s) | Release date | Release year | Release price (USD) | Cloud pricing ($ per hour) data from 03 July 2023; Google cloud and lambda labs prices | Manufacturing Process (Technology Node) | Number of transistors in million | Die Size in mm^2 | TDP in W | Base Clock in MHz | Boost Clock in MHz | Memory Clock in MHz | Memory bus in bit | Shading units | TMUs | ROPs | SM count | Tensor cores | RT cores | Prominent Years of usage | Link to datasheet | Secondary datasheet | Third datasheet | Source for the Price | ML Hardware | |
2 | NVIDIA GeForce RTX 4070 | NVIDIA | 6.26E+11 | 4.01E+13 | 4.01E+13 | 1.20E+10 | 5.04E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | 03/01/2023 | 2023 | $799 | 35800 | 295 | 285 | 2310 | 2610 | 1313 | 192 | 7680 | 240 | 80 | 60 | 240 | 60 | 1 | |||||||||||||||||
3 | AMD Radeon RX 7900 XTX | AMD | 1.92E+12 | 6.14E+13 | 1.23E+14 | 2.40E+10 | 9.60E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | 03/11/2022 | 2022 | $999 | 57700 | 529 | 355 | 1855 | 2499 | 2500 | 384 | 6144 | 384 | 192 | 0 | 96 | https://www.techpowerup.com/gpu-specs/radeon-rx-7900-xtx.c3941 | https://www.pcgamer.com/amd-radeon-rx-7900-xtx-xt-price-release-date-specs/ | 1 | ||||||||||||||||
4 | NVIDIA L40 | NVIDIA | 1.41E+12 | 9.05E+13 | 9.05E+13 | 1.81E+14 | 3.62E+14 | 3.62E+14 | 7.24E+14 | 4.80E+10 | 8.64E+11 | 2.09E+02 | PCIe 4.0 x16 | 63.00 | 13/10/2022 | 2022 | 76300 | 608 | 300 | 735 | 2490 | 2250 | 384 | 18176 | 568 | 192 | 142 | 568 | 142 | https://www.techpowerup.com/gpu-specs/l40.c3959; https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/support-guide/NVIDIA-L40-Datasheet-January-2023.pdf | 1 | |||||||||||||
5 | NVIDIA GeForce RTX 4090 | NVIDIA | 1.29E+12 | 8.26E+13 | 8.26E+13 | 8.26E+13 | 3.30E+14 | 6.61E+14 | 6.61E+14 | 1.32E+15 | 2.40E+10 | 1.01E+12 | 3.27E+02 | PCIe 4.0 x16 | 63.00 | 20/09/2022 | 2022 | $1599 | TSMC 4N NVIDIA Custom Process | 76300 | 608 | 450 | 2235 | 2520 | 1313 | 384 | 16384 | 512 | 176 | 128 | 512 | 128 | https://www.techpowerup.com/gpu-specs/geforce-rtx-4090.c3889 | https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf | https://www.pcgamesn.com/nvidia/rtx-4090-release-date-price-spec-and-benchmarks | 1 | ||||||||
6 | NVIDIA GeForce RTX 4080 | NVIDIA | 7.62E+11 | 4.87E+13 | 4.87E+13 | 1.60E+10 | 7.17E+11 | 0.00E+00 | PCIe 4.0 x16 | 62.00 | 20/09/2022 | 2022 | $1199 | 45900 | 379 | 320 | 2205 | 2505 | 1400 | 256 | 9728 | 304 | 112 | 76 | 304 | 76 | https://www.techpowerup.com/gpu-specs/geforce-rtx-4080.c3888; | 1 | ||||||||||||||||
7 | NVIDIA H100 SXM | NVIDIA | 3.35E+13 | 6.69E+13 | 1.34E+14 | 4.95E+14 | 9.90E+14 | 1.98E+15 | 1.98E+15 | 8.00E+10 | 3.35E+12 | 2.95E+02 | PCIe 5.0 x16 | 126.00 | NVLink 4.0 | 9.00E+02 | 22/03/2022 | 2022 | $1.99 | 80000 | 814 | 700 | 1665 | 1980 | 1313 | 5120 | 16896 | 528 | 24 | 132 | 528 | https://www.techpowerup.com/gpu-specs/h100-sxm5.c3900 | https://resources.nvidia.com/en-us-tensor-core/nvidia-tensor-core-gpu-datasheet | https://nvdam.widen.net/s/95bdhpsgrs/nvidia_h100_tensor_core_gpu_architecture_whitepaper_v1.03#page=39 | seems to be sold between 20k and 40k USD | 1 | ||||||||
8 | NVIDIA GeForce RTX 3090 Ti | NVIDIA | 6.25E+11 | 4.00E+13 | 4.00E+13 | 4.00E+13 | 1.60E+14 | 3.20E+14 | 6.40E+14 | 2.40E+10 | 1.01E+12 | 1.59E+02 | PCIe 4.0 x16 | 63.00 | 27/01/2022 | 2022 | $1,999 | Samsung 8 nm 8N NVIDIA Custom Process | 28300 | 628 | 450 | 1560 | 1860 | 1313 | 384 | 10752 | 336 | 112 | 84 | 336 | 84 | https://www.techpowerup.com/gpu-specs/geforce-rtx-3090-ti.c3829 | https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf | https://www.wikiwand.com/en/GeForce_30_series | 1 | |||||||||
9 | AMD Radeon Instinct MI250X | AMD | 4.79E+13 | 4.79E+13 | 3.83E+14 | 9.57E+13 | 3.83E+14 | 3.83E+14 | 1.28E+11 | 3.20E+12 | 1.20E+02 | PCIe 4.0 x16 | 63.00 | AMD Infinity Fabric | 4.00E+02 | 08/11/2021 | 2021 | TSMC 6nm | 560 | https://www.amd.com/system/files/documents/amd-instinct-mi200-datasheet.pdf | https://www.wikiwand.com/en/AMD_Instinct | 1 | ||||||||||||||||||||||
10 | Google TPU v4 | 2.75E+14 | 4.58E+13 | 3.20E+10 | 1.20E+12 | 0.00E+00 | TPU ICI Links | 3.36E+02 | 20/05/2021 | 2021 | $1.77 | https://cloud.google.com/tpu/docs/system-architecture-tpu-vm | https://dl.acm.org/doi/pdf/10.1145/3360307 | 1 | ||||||||||||||||||||||||||||||
11 | NVIDIA RTX A5000 | NVIDIA | 8.68E+11 | 2.78E+13 | 2.78E+13 | 2.40E+10 | 7.68E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | 4.05E+02 | 12/04/2021 | 2021 | $2250 | 28300 | 628 | 230 | 1170 | 1695 | 2000 | 384 | 8192 | 256 | 96 | 64 | 256 | 64 | 2021-21 | https://www.techpowerup.com/gpu-specs/rtx-a5000.c3748 | https://develop3d.com/hardware/nvidia-rtx-a4000-and-rtx-a5000-gpus-launch/ | 1 | |||||||||||||
12 | NVIDIA RTX A4000 | NVIDIA | 5.99E+11 | 1.92E+13 | 1.92E+13 | 1.60E+10 | 4.48E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | 12/04/2021 | 2021 | $1000 | 17400 | 392 | 140 | 735 | 1560 | 1750 | 256 | 6144 | 192 | 96 | 48 | 192 | 48 | techpowerup.com/gpu-specs/rtx-a4000.c3756 | https://develop3d.com/hardware/nvidia-rtx-a4000-and-rtx-a5000-gpus-launch/ | 1 | |||||||||||||||
13 | NVIDIA A10G | NVIDIA | 9.85E+11 | 3.15E+13 | 3.15E+13 | 2.40E+10 | 6.00E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | 12/04/2021 | 2021 | $0.60 | 28300 | 628 | 150 | 1320 | 1710 | 1563 | 384 | 9216 | 288 | 96 | 72 | 288 | 72 | https://www.techpowerup.com/gpu-specs/a10g.c3798 | 1 | ||||||||||||||||
14 | NVIDIA A40 PCIe | NVIDIA | 5.85E+11 | 3.74E+13 | 3.74E+13 | 7.48E+13 | 1.50E+14 | 2.99E+14 | 4.80E+10 | 6.96E+11 | 2.15E+02 | PCIe 4.0 x16 | 63.00 | 05/10/2020 | 2020 | 28300 | 628 | 300 | 1305 | 1740 | 1812 | 384 | 10752 | 336 | 112 | 84 | 336 | 84 | https://www.techpowerup.com/gpu-specs/a40-pcie.c3700; https://images.nvidia.com/content/Solutions/data-center/a40/nvidia-a40-datasheet.pdf | 1 | ||||||||||||||
15 | NVIDIA A100 | NVIDIA | 9.75E+12 | 1.95E+13 | 7.80E+13 | 1.56E+14 | 3.12E+14 | 6.24E+14 | 8.00E+10 | 2.04E+12 | 1.53E+02 | PCIe 4.0 x16 | 63.00 | NVLink | 6.00E+02 | 9.25E+02 | 16/11/2020 | 2020 | $15,000 | $1.10 | TSMC 7nm | 54200 | 826 | 400 | 1275 | 1410 | 1593 | 5120 | 6912 | 432 | 160 | 108 | 432 | 2020-21 | https://www.techpowerup.com/gpu-specs/a100-sxm4-80-gb.c3746 | https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf | 1 | |||||||
16 | NVIDIA GeForce RTX 3090 | NVIDIA | 5.56E+11 | 3.56E+13 | 3.56E+13 | 2.84E+14 | 5.68E+14 | 2.40E+10 | 9.36E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | NVLink 3.0 | 112.5 | 4.71E+02 | 01/09/2020 | 2020 | $1499 | Samsung 8 nm 8N NVIDIA Custom Process | 28300 | 628 | 350 | 1395 | 1695 | 1219 | 384 | 10496 | 328 | 112 | 82 | 328 | 82 | 2020-21 | https://www.techpowerup.com/gpu-specs/geforce-rtx-3090.c3622 | https://images.nvidia.com/aem-dam/en-zz/Solutions/geforce/ampere/pdf/NVIDIA-ampere-GA102-GPU-Architecture-Whitepaper-V1.pdf#page=38 | https://www.tomsguide.com/news/nvidia-geforce-rtx-3090 | 1 | |||||||
17 | NVIDIA RTX A6000 | NVIDIA | 1.21E+12 | 3.87E+13 | 3.87E+13 | 4.80E+10 | 7.68E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | NVLink 3.0 | 112.5 | 05/10/2020 | 2020 | $4650 | $0.80 | 28300 | 628 | 300 | 1410 | 1800 | 2000 | 384 | 10752 | 336 | 112 | 84 | 336 | 84 | https://www.techpowerup.com/gpu-specs/rtx-a6000.c3686 | https://wccftech.com/nvidia-rtx-a6000-48-gb-workstation-graphics-card-full-ga102-gpu-4650-us/ | 1 | ||||||||||||
18 | NVIDIA GeForce RTX 3080 | NVIDIA | 4.65E+11 | 2.98E+13 | 2.98E+13 | 1.00E+10 | 7.60E+11 | 0.00E+00 | PCIe 4.0 x16 | 63.00 | 01/09/2020 | 2020 | $699 | 28300 | 628 | 320 | 1440 | 1710 | 1188 | 320 | 8704 | 272 | 96 | 68 | 272 | 68 | https://www.techpowerup.com/gpu-specs/geforce-rtx-3080.c3621 | https://www.tomsguide.com/news/nvidia-geforce-rtx-3080-ti | 1.00E+00 | |||||||||||||||
19 | Google TPU V3 | 1.23E+14 | 4.00E+12 | 3.20E+10 | 9.00E+11 | 0.00E+00 | TPU ICI Links | 3.28E+02 | 01/10/2018 | 2018 | $0.62 | 2018-21 | https://cloud.google.com/tpu/docs/system-architecture-tpu-vm | A Domain-Specific Supercomputer for Training | 1.00E+00 | |||||||||||||||||||||||||||||
20 | NVIDIA GeForce RTX 2080 Ti | NVIDIA | 4.20E+11 | 1.35E+13 | 2.69E+13 | 1.14E+14 | 2.28E+14 | 4.55E+14 | 1.10E+10 | 6.16E+11 | 1.85E+02 | PCIe 3.0 x16 | 31.50 | NVLink 2.0 | 1.00E+02 | 2.75E+02 | 20/09/2018 | 2018 | $999 | TSMC 12 nm FFN (FinFET NVIDIA) | 18600 | 754 | 250 | 1350 | 1545 | 1750 | 352 | 4352 | 272 | 88 | 68 | 544 | 68 | 2018-21 | https://www.techpowerup.com/gpu-specs/geforce-rtx-2080-ti.c3305 | https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf | 1.00E+00 | |||||||
21 | NVIDIA Quadro RTX 8000 | NVIDIA | 5.01E+11 | 1.63E+13 | 3.26E+13 | 4.80E+10 | 6.72E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | NVLink 2.0 | 1.00E+02 | 3.00E+02 | 13/08/2018 | 2018 | $9999 | 18600 | 754 | 260 | 1395 | 1770 | 1750 | 384 | 4608 | 288 | 96 | 72 | 576 | 72 | 2018-21 | https://www.techpowerup.com/gpu-specs/quadro-rtx-8000.c3306 | 1.00E+00 | ||||||||||||
22 | NVIDIA T4 | NVIDIA | 2.54E+11 | 8.10E+12 | 6.51E+13 | 1.60E+10 | 3.20E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 13/09/2018 | 2018 | $0.22 | 13600 | 545 | 70 | 585 | 1590 | 1250 | 256 | 2560 | 160 | 64 | 40 | 320 | 40 | https://www.techpowerup.com/gpu-specs/tesla-t4.c3316 | 1.00E+00 | ||||||||||||||||
23 | NVIDIA Quadro RTX 4000 | NVIDIA | 2.23E+11 | 7.10E+12 | 1.42E+13 | 8.00E+09 | 4.16E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 13/11/2018 | 2018 | $899 | 13600 | 545 | 160 | 1005 | 1545 | 1625 | 256 | 2304 | 144 | 64 | 36 | 288 | 36 | https://www.techpowerup.com/gpu-specs/quadro-rtx-4000.c3336 | 1 | ||||||||||||||||
24 | NVIDIA Quadro RTX 5000 | NVIDIA | 3.49E+11 | 1.12E+13 | 2.23E+13 | 1.60E+10 | 4.48E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | NVLink 2.0 | 50 | 13/08/2018 | 2018 | $2299 | 13600 | 545 | 230 | 1620 | 1815 | 1750 | 256 | 3072 | 192 | 64 | 48 | 384 | 48 | https://www.techpowerup.com/gpu-specs/quadro-rtx-5000.c3308 | 1 | ||||||||||||||
25 | NVIDIA Quadro RTX 6000 | NVIDIA | 5.10E+11 | 1.63E+13 | 3.26E+13 | 2.40E+10 | 6.72E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | NVLink 2.0 | 100 | 13/08/2018 | 2018 | $6299 | $0.50 | 18600 | 754 | 260 | 1440 | 1770 | 1750 | 384 | 4608 | 288 | 96 | 72 | 576 | 72 | https://www.techpowerup.com/gpu-specs/quadro-rtx-6000.c3307 | https://woolypooly.com/en/device/gpu/nvidia-quadro-rtx-6000 | 1 | ||||||||||||
26 | NVIDIA Titan Xp | NVIDIA | 3.80E+11 | 1.22E+13 | 1.90E+11 | 1.20E+10 | 5.48E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 06/04/2017 | 2017 | $1199 | 11800 | 471 | 250 | 1405 | 1582 | 1426 | 384 | 3840 | 240 | 96 | 30 | https://www.techpowerup.com/gpu-specs/titan-xp.c2948 | 1 | ||||||||||||||||||
27 | NVIDIA Titan V | NVIDIA | 7.45E+12 | 1.49E+13 | 2.98E+13 | 1.20E+10 | 6.51E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 07/12/2017 | 2017 | $2,999 | 21100 | 815 | 250 | 1200 | 1455 | 848 | 3072 | 5120 | 320 | 96 | 80 | 640 | https://www.techpowerup.com/gpu-specs/titan-v.c3051 | 1 | |||||||||||||||||
28 | NVIDIA Tesla V100 SMX2 | NVIDIA | 7.80E+12 | 1.57E+13 | 3.14E+13 | 1.30E+14 | 1.60E+10 | 8.97E+11 | 1.45E+02 | PCIe 3.0 x16 | 31.50 | NVLink 2.0 | 3.00E+02 | 21/06/2017 | 2017 | $11,500 | $0.55 | 21100 | 815 | 300 | 1312 | 1530 | 876 | 4096 | 5120 | 320 | 128 | 80 | 640 | 2017-21 (though discontinued in 2020) | https://images.nvidia.com/content/technologies/volta/pdf/volta-v100-datasheet-update-us-1165301-r5.pdf | https://www.techpowerup.com/gpu-specs/tesla-v100-sxm2-16-gb.c3018 | 1 | |||||||||||
29 | Google TPU V2 | 3.00E+12 | 4.60E+13 | 3.00E+12 | 1.60E+10 | 6.00E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | TPU ICI Links | 2.48E+02 | 01/05/2017 | 2017 | $0.46 | 2017-21 | A Domain-Specific Supercomputer for Training | 1 | |||||||||||||||||||||||||||
30 | NVIDIA Geforce GTX 1080 Ti | NVIDIA | 3.54E+11 | 1.13E+13 | 1.77E+11 | 1.10E+10 | 4.84E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 1.96E+02 | 10/03/2017 | 2017 | $699 | 11800 | 471 | 250 | 1481 | 1582 | 1376 | 352 | 3584 | 224 | 88 | 28 | https://www.techpowerup.com/gpu-specs/geforce-gtx-1080-ti.c2877 | 1 | |||||||||||||||||
31 | NVIDIA Quadro P4000 | NVIDIA | 1.65E+11 | 5.30E+12 | 8.29E+10 | 8.00E+09 | 2.43E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 06/02/2017 | 2017 | $815 | 7200 | 314 | 105 | 1202 | 1480 | 1901 | 256 | 1792 | 112 | 64 | 14 | https://www.techpowerup.com/gpu-specs/quadro-p4000.c2930 | 1 | ||||||||||||||||||
32 | NVIDIA P100 | NVIDIA | 4.70E+12 | 9.30E+12 | 1.87E+13 | 1.60E+10 | 7.32E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | NVLink 1.0 | 160 | 05/04/2016 | 2016 | $5699 | $0.919 | https://images.nvidia.com/content/tesla/pdf/nvidia-tesla-p100-PCIe-datasheet.pdf | 1 | ||||||||||||||||||||||||||
33 | NVIDIA Tesla P4 | NVIDIA | 1.78E+11 | 5.70E+12 | 8.90E+10 | 2.20E+13 | 8.00E+09 | 1.92E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 13/09/2016 | 2016 | $0.378 | 7200 | 314 | 75 | 886 | 1114 | 1502 | 256 | 2560 | 160 | 64 | 20 | https://www.techpowerup.com/gpu-specs/tesla-p4.c2879 | https://images.nvidia.com/content/pdf/tesla/184457-Tesla-P4-Datasheet-NV-Final-Letter-Web.pdf | 1 | ||||||||||||||||
34 | NVIDIA Quadro P5000 | NVIDIA | 2.77E+11 | 8.87E+12 | 1.39E+11 | 1.60E+10 | 2.89E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 01/10/2016 | 2016 | $2499 | 7200 | 314 | 180 | 1607 | 1733 | 1127 | 256 | 2560 | 160 | 64 | 20 | https://www.techpowerup.com/gpu-specs/quadro-p5000.c2864 | https://www.techpowerup.com/gpu-specs/quadro-p5000.c2864 | 1 | |||||||||||||||||
35 | NVIDIA Quadro P6000 | NVIDIA | 3.95E+11 | 1.26E+13 | 1.97E+11 | 2.40E+10 | 4.33E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 01/10/2016 | 2016 | $5999 | 11800 | 471 | 250 | 1506 | 1645 | 1127 | 384 | 3840 | 240 | 96 | 30 | https://www.techpowerup.com/gpu-specs/quadro-p6000.c2865 | 1 | ||||||||||||||||||
36 | NVIDIA P40 | NVIDIA | 3.67E+11 | 1.18E+13 | 1.84E+11 | 2.40E+10 | 6.94E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 13/09/2016 | 2016 | $5699 | 11800 | 471 | 250 | 1303 | 1531 | 1808 | 384 | 3840 | 240 | 96 | 30 | https://www.techpowerup.com/gpu-specs/tesla-p40.c2878 | 1 | ||||||||||||||||||
37 | NVIDIA GTX Titan X | NVIDIA | 2.09E+11 | 6.69E+12 | 1.20E+10 | 3.37E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 17/03/2015 | 2015 | $999 | 8000 | 601 | 250 | 1000 | 1089 | 1753 | 384 | 3072 | 192 | 96 | 24 | https://www.techpowerup.com/gpu-specs/geforce-gtx-titan-x.c2632 | 1 | |||||||||||||||||||
38 | NVIDIA M40 | NVIDIA | 2.14E+11 | 6.83E+12 | 1.20E+10 | 2.88E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 10/11/2015 | 2015 | 8000 | 601 | 250 | 948 | 1112 | 1502 | 384 | 3072 | 192 | 96 | 24 | https://www.techpowerup.com/gpu-specs/tesla-m40.c2771 | 1 | ||||||||||||||||||||
39 | NVIDIA Quadro K1200 | NVIDIA | 3.60E+10 | 1.15E+12 | 4.00E+09 | 8.00E+10 | 0.00E+00 | PCIe 2.0 x16 | 15.75 | 28/01/2015 | 2015 | 1870 | 148 | 45 | 1058 | 1124 | 1250 | 128 | 512 | 32 | 16 | 4 | https://www.techpowerup.com/gpu-specs/quadro-k1200.c2641 | 1 | ||||||||||||||||||||
40 | NVIDIA Quadro M4000 | NVIDIA | 8.04E+10 | 2.57E+12 | 8.00E+09 | 1.92E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 29/06/2015 | 2015 | 5200 | 398 | 120 | 773 | 1502 | 256 | 1664 | 104 | 64 | 13 | https://www.techpowerup.com/gpu-specs/quadro-m4000.c2757 | 1 | |||||||||||||||||||||
41 | NVIDIA TESLA M60 | NVIDIA | 3.02E+11 | 9.65E+12 | 1.60E+10 | 3.21E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 30/08/2015 | 2015 | 10400 | 796 | 300 | 557 | 1178 | 1253 | 512 | 4096 | 256 | 128 | 32 | https://www.techpowerup.com/gpu-specs/tesla-m60.c2760 | 1 | ||||||||||||||||||||
42 | NVIDIA GTX Titan Black | NVIDIA | 1.88E+12 | 5.65E+12 | 6.00E+09 | 3.36E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 18/02/2014 | 2014 | $999 | 7080 | 561 | 250 | 889 | 980 | 1750 | 384 | 2880 | 240 | 48 | 15 | https://www.techpowerup.com/gpu-specs/geforce-gtx-titan-black.c2549 | 1 | |||||||||||||||||||
43 | NVIDIA Tesla K80 | NVIDIA | 2.74E+12 | 8.13E+12 | 2.40E+10 | 2.41E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 17/11/2014 | 2014 | $5000 | $0.283 | 14200 | 1122 | 300 | 562 | 824 | 1253 | 768 | 4992 | 416 | 96 | 26 | 2015-2017 | https://www.techpowerup.com/gpu-specs/tesla-k80.c2616 | https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/tesla-product-literature/TeslaK80-datasheet.pdf | https://www.anandtech.com/show/8729/nvidia-launches-tesla-k80-gk210-gpu | 1 | |||||||||||||||
44 | NVIDIA Tesla K40s | NVIDIA | 1.68E+12 | 5.05E+12 | 1.20E+10 | 2.88E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 22/11/2013 | 2013 | $7699 | 7080 | 561 | 245 | 745 | 876 | 1502 | 384 | 2880 | 240 | 48 | 15 | 2015-2017 | https://www.techpowerup.com/gpu-specs/tesla-k40s.c2528 | 1 | ||||||||||||||||||
45 | NVIDIA Quadro K6000 | NVIDIA | 1.73E+12 | 5.20E+12 | 1.20E+10 | 2.88E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | 23/07/2013 | 2013 | $5265 | 7080 | 561 | 225 | 797 | 902 | 1502 | 384 | 2880 | 240 | 48 | 15 | https://www.techpowerup.com/gpu-specs/quadro-k6000.c2426 | 1 | |||||||||||||||||||
46 | NVIDIA Tesla K20c | NVIDIA | 1.17E+12 | 3.52E+12 | 5.00E+09 | 2.08E+11 | 0.00E+00 | PCIe 2.0 x16 | 15.75 | 12/11/2012 | 2012 | $3199 | 7080 | 561 | 225 | 706 | 1300 | 320 | 2496 | 208 | 40 | 13 | https://www.techpowerup.com/gpu-specs/tesla-k20c.c564 | 1 | ||||||||||||||||||||
47 | NVIDIA GeForce GTX 580 | NVIDIA | 1.98E+11 | 1.58E+12 | 1.54E+09 | 1.92E+11 | 0.00E+00 | PCIe 2.0 x16 | 15.75 | 09/11/2010 | 2010 | $499 | 3000 | 520 | 244 | 772 | 1544 | 1002 | 384 | 512 | 64 | 48 | 16 | https://www.techpowerup.com/gpu-specs/geforce-gtx-580.c270 | 1 | |||||||||||||||||||
48 | NVIDIA GeForce GTX 280 | NVIDIA | 7.78E+10 | 6.22E+11 | 1.02E+09 | 1.41E+11 | 0.00E+00 | PCIe 2.0 x16 | 2008 | $649 | 1400 | 576 | 236 | 602 | 1107 | 512 | 240 | 80 | 32 | 30 | https://www.techpowerup.com/gpu-specs/geforce-gtx-280.c216 | 1 | ||||||||||||||||||||||
49 | NVIDIA P100 PCIe 16GB | NVIDIA | 4.70E+12 | 9.56E+12 | 1.91E+13 | 1.60E+10 | 7.32E+11 | 0.00E+00 | PCIe 3.0 x16 | 31.50 | NVLink 1.0 | 1.60E+02 | 20/06/2016 | 2016 | $5699 | $0.919 | 15300 | 610 | 250 | 1190 | 1329 | 715 | 4096 | 3584 | 224 | 96 | 56 | https://www.techpowerup.com/gpu-specs/tesla-p100-pcie-16-gb.c2888 | https://images.nvidia.com/content/tesla/pdf/nvidia-tesla-p100-PCIe-datasheet.pdf | 1 | ||||||||||||||
50 | Google TPUv5e | 1.97E+14 | 3.93E+14 | 1.60E+10 | 8.19E+11 | 200 | https://cloud.google.com/tpu/docs/v5e | 1 | ||||||||||||||||||||||||||||||||||||
51 | Google TPUv5p | 4.59E+14 | 9.50E+10 | 2.77E+12 | 600 | https://cloud.google.com/tpu/docs/v5p | 1 | |||||||||||||||||||||||||||||||||||||
52 | Google TPUv6 | 9.26E+14 | 1.85E+15 | 3.20E+10 | 1.64E+12 | 2024 | https://cloud.google.com/blog/products/compute/introducing-trillium-6th-gen-tpus | 1 | ||||||||||||||||||||||||||||||||||||
53 | NVIDIA B100 | NVIDIA | 3.00E+13 | 1.75E+15 | 8.75E+14 | 1.75E+15 | 3.50E+15 | 7.00E+15 | 1.92E+11 | 8.00E+12 | PCIe 6.0 | 2.56E+11 | NVLink 5.0 | 1.80E+03 | 700 | https://www.hyperstack.cloud/nvidia-blackwell-b100 | 1 | |||||||||||||||||||||||||||
54 | AMD Radeon Instinct MI300 | AMD | 4.79E+13 | 4.79E+13 | 3.83E+14 | 1.28E+11 | 6.55E+12 | PCIE 5.0 x16 | 04/01/2023 | 2023 | 600 | https://www.techpowerup.com/gpu-specs/radeon-instinct-mi300.c4019 | 1 | |||||||||||||||||||||||||||||||
55 | Huawei Ascend 910 | Huawei | 2.56E+14 | 5.12E+14 | 3.20E+10 | 1.23E+12 | https://www.cmc.ca/wp-content/uploads/2020/03/Zhan-Xu-Huawei.pdf | |||||||||||||||||||||||||||||||||||||
56 | ||||||||||||||||||||||||||||||||||||||||||||
57 | ||||||||||||||||||||||||||||||||||||||||||||
58 | ||||||||||||||||||||||||||||||||||||||||||||
59 | ||||||||||||||||||||||||||||||||||||||||||||
60 | ||||||||||||||||||||||||||||||||||||||||||||
61 | ||||||||||||||||||||||||||||||||||||||||||||
62 | ||||||||||||||||||||||||||||||||||||||||||||
63 | ||||||||||||||||||||||||||||||||||||||||||||
64 | ||||||||||||||||||||||||||||||||||||||||||||
65 | ||||||||||||||||||||||||||||||||||||||||||||
66 | ||||||||||||||||||||||||||||||||||||||||||||
67 | ||||||||||||||||||||||||||||||||||||||||||||
68 | ||||||||||||||||||||||||||||||||||||||||||||
69 | ||||||||||||||||||||||||||||||||||||||||||||
70 | ||||||||||||||||||||||||||||||||||||||||||||
71 | ||||||||||||||||||||||||||||||||||||||||||||
72 | ||||||||||||||||||||||||||||||||||||||||||||
73 | ||||||||||||||||||||||||||||||||||||||||||||
74 | ||||||||||||||||||||||||||||||||||||||||||||
75 | ||||||||||||||||||||||||||||||||||||||||||||
76 | ||||||||||||||||||||||||||||||||||||||||||||
77 |