1 | ARCH | COMPUTE CAP | VRAM | MEM PF | MEM SP | MHZ | CUDAs | MHZ x CUDAs | FP32 TFLOPS | TCORES | PERF AGG | ENERGY | ENPRICE | PPRICE | TPRICE | BANG4BUCK | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | RTX 2070 | Turing | 7.5 | 8 | 0.92 | 448 | 1410 | 2304 | 298.87 | 7.5 | 288 | 2.0 | 175 | €350 | €300 | €300 | €149 | 100% |
3 | RTX 2070 Super | Turing | 7.5 | 8 | 0.92 | 448 | 1605 | 2560 | 378.01 | 9.1 | 320 | 2.3 | 175 | €350 | €350 | €350 | €149 | 100% |
4 | RTX 2060 | Turing | 7.5 | 6 | 0.88 | 336 | 1365 | 1920 | 230.63 | 6.5 | 240 | 1.7 | 160 | €320 | €250 | €250 | €150 | 99% |
5 | RTX 2060 Super | Turing | 7.5 | 8 | 0.92 | 448 | 1470 | 2176 | 294.28 | 7.2 | 272 | 1.9 | 175 | €350 | €300 | €300 | €156 | 96% |
6 | RTX 2080 Super | Turing | 7.5 | 8 | 0.92 | 496 | 1650 | 3072 | 466.33 | 11.2 | 384 | 2.9 | 215 | €430 | €450 | €450 | €158 | 94% |
7 | RTX 2080 | Turing | 7.5 | 8 | 0.92 | 448 | 1515 | 2944 | 410.33 | 10.0 | 368 | 2.6 | 250 | €500 | €450 | €450 | €171 | 87% |
8 | RTX 3080 | Ampere | 8.6 | 10 | 0.96 | 760 | 1440 | 8704 | 1203.24 | 29.77 | 272 | 4.6 | 320 | €640 | €900 | €900 | €198 | 75% |
9 | GTX 1080 Ti | Pascal | 6.1 | 11 | 0.98 | 484 | 1596 | 3584 | 560.57 | 11.1 | 0 | 1.4 | 250 | €500 | €300 | €300 | €208 | 72% |
10 | RTX 3070 | Ampere | 8.6 | 8 | 0.92 | 448 | 1500 | 5888 | 812.54 | 20.31 | 184 | 3.1 | 220 | €440 | €700 | €700 | €226 | 66% |
11 | RTX 3080 Ti | Ampere | 8.6 | 12 | 1 | 912 | 1365 | 10240 | 1397.76 | 34.1 | 320 | 5.3 | 350 | €700 | €1,200 | €1,200 | €227 | 66% |
12 | GTX 1080 | Pascal | 6.1 | 8 | 0.92 | 320 | 1632 | 2560 | 384.37 | 8.9 | 0 | 1.1 | 150 | €300 | €250 | €250 | €234 | 64% |
13 | RTX 3070 Ti | Ampere | 8.6 | 8 | 0.92 | 608 | 1575 | 6144 | 890.27 | 21.75 | 192 | 3.3 | 290 | €580 | €800 | €800 | €241 | 62% |
14 | RTX 3060 Ti | Ampere | 8.6 | 8 | 0.92 | 448 | 1410 | 4864 | 630.96 | 16.2 | 152 | 2.5 | 200 | €400 | €600 | €600 | €244 | 61% |
15 | GTX 1070 Ti | Turing | 7.5 | 8 | 0.92 | 256 | 1607 | 2432 | 359.56 | 8.2 | 0 | 1.0 | 180 | €360 | €250 | €250 | €251 | 59% |
16 | RTX 3090 | Ampere | 8.6 | 24 | 1.24 | 936 | 1395 | 10496 | 1815.60 | 35.58 | 328 | 6.0 | 350 | €700 | €1,500 | €1,500 | €252 | 59% |
17 | RTX 3050 | Ampere | 8.6 | 8 | 0.92 | 224 | 1552 | 2560 | 365.53 | 9.1 | 80 | 1.4 | 130 | €260 | €350 | €350 | €254 | 59% |
18 | GTX 1070 | Pascal | 6.1 | 8 | 0.92 | 256 | 1506 | 1920 | 266.02 | 6.4 | 0 | 0.8 | 150 | €300 | €200 | €200 | €263 | 57% |
19 | RTX 3060 | Ampere | 8.6 | 12 | 1 | 360 | 1320 | 3584 | 473.09 | 12.74 | 112 | 1.9 | 170 | €340 | €500 | €500 | €266 | 56% |
20 | RTX 3090 Ti | Ampere | 8.6 | 24 | 1.24 | 1008 | 1560 | 10752 | 2079.87 | 40 | 336 | 6.6 | 450 | €900 | €1,800 | €1,800 | €272 | 55% |
21 | GTX 1060 | Pascal | 6.1 | 6 | 0.88 | 192 | 1506 | 1280 | 169.64 | 4.4 | 0 | 0.5 | 120 | €240 | €150 | €150 | €298 | 50% |
22 | RTX 2080 Ti | Turing | 7.5 | 11 | 0.98 | 616 | 1350 | 4352 | 575.77 | 13.5 | 544 | 3.8 | 250 | €500 | €1,260 | €1,260 | €334 | 45% |
23 | GTX 1660 Super | Turing | 7.5 | 6 | 0.88 | 336 | 1530 | 1408 | 189.57 | 5.0 | 0 | 0.6 | 125 | €250 | €200 | €200 | €352 | 42% |
24 | GTX 1660 Ti | Turing | 7.5 | 6 | 0.88 | 288 | 1500 | 1536 | 202.75 | 5.4 | 0 | 0.6 | 120 | €240 | €250 | €250 | €410 | 36% |
25 | RTX A4000 | Ampere | 8.6 | 16 | 1.08 | 448 | 735 | 6144 | 487.71 | 19.1 | 192 | 2.6 | 140 | €280 | €1,100 | €1,100 | €420 | 35% |
26 | Quadro RTX 4000 | Turing | 7.5 | 8 | 0.92 | 416 | 1005 | 2304 | 213.03 | 7.1 | 288 | 1.9 | 160 | €320 | €1,000 | €1,000 | €533 | 28% |
27 | RTX A5000 | Ampere | 8.6 | 24 | 1.24 | 768 | 1170 | 8192 | 1188.50 | 27.8 | 256 | 4.3 | 230 | €460 | €2,500 | €2,500 | €575 | 26% |
28 | Quadro RTX 5000 | Turing | 7.5 | 16 | 1.08 | 448 | 1620 | 3072 | 537.48 | 11.2 | 384 | 2.9 | 230 | €460 | €2,000 | €2,000 | €680 | 22% |
29 | RTX A6000 | Ampere | 8.6 | 48 | 1.72 | 768 | 1410 | 10752 | 2607.58 | 38.7 | 336 | 7.2 | 300 | €600 | €6,000 | €6,000 | €830 | 18% |
30 | Tesla T4 | Turing | 7.5 | 16 | 1.08 | 320 | 585 | 2560 | 161.74 | 8.0 | 320 | 2.0 | 70 | €140 | €2,500 | €2,500 | €1,255 | 12% |
31 | Quadro RTX 8000 | Turing | 7.5 | 48 | 1.72 | 672 | 1395 | 4608 | 1105.64 | 16.3 | 576 | 4.8 | 260 | €520 | €8,000 | €8,000 | €1,673 | 9% |
32 | Tesla V100 | Volta | 7.0 | 16 | 1.08 | 900 | 1530 | 5376 | 888.33 | 15.0 | 672 | 4.8 | 250 | €500 | €8,200 | €8,200 | €1,711 | 9% |
33 | A100 | Ampere | 8.0 | 40 | 1.56 | 1555 | 1410 | 6912 | 1520.36 | 19.5 | 432 | 5.0 | 250 | €500 | €11,000 | €11,000 | €2,218 | 7% |
34 | H100 | Hopper | 9.0 | 80 | 2.36 | 1280 | 1065 | 7296 | 1833.78 | 24.1 | 456 | 5.8 | 350 | €700 | €35,000 | €35,000 | €6,076 | 2% |
35 | ||||||||||||||||||
36 | ||||||||||||||||||
37 | Color-coding | Variables | ||||||||||||||||
38 | Current Gen (Ampere) | Consumer | Workstation/server | Years of operation | 0 | |||||||||||||
39 | Previous Gen (Volta/Turing) | Consumer | Workstation/server | Performance degredation mem bus factor | 0.02 | |||||||||||||
40 | Older Gen (Pascal & Older) | Consumer | Workstation/server | Price per Watt per year | €2.00 | |||||||||||||
41 | ||||||||||||||||||
42 | ||||||||||||||||||
43 | Legend | |||||||||||||||||
44 | ARCH | GPU Architecture | ||||||||||||||||
45 | COMPUTE CAP | Compute Capability | ||||||||||||||||
46 | VRAM | Video card memory capacity | ||||||||||||||||
47 | MEM PF | Artificially calculated bottleneck factor for memory capacity; experimentally determined | ||||||||||||||||
48 | MEM SP | Memory speed in GB/s | ||||||||||||||||
49 | MHZ | Chip base clock speed | ||||||||||||||||
50 | CUDAs | Number of CUDA cores | ||||||||||||||||
51 | MHZ x CUDAs | Performance indicator 1: Base clock times the number of CUDA cores times MEM PF divided by 10000 | ||||||||||||||||
52 | FP32 TFLOPS | Performance inidcator 2: Single-precision floating point performance | ||||||||||||||||
53 | TCORES | Number of Tensor Cores | ||||||||||||||||
54 | PERG AGG | Aggregated performance: weighted average of performance indicator 1 and 2 | ||||||||||||||||
55 | ENERGY | Rated TDP as estimate of 100% load energy usage | ||||||||||||||||
56 | ENPRICE | Estimated cost of 100% operation per year | ||||||||||||||||
57 | PPRICE | Current new price or estimated second-hand price (in Europe) | ||||||||||||||||
58 | TPRICE | PPRICE + ENPRICE times "Years of operation" | ||||||||||||||||
59 | BANG4BUCK | TPRICE divided by PERF AGG | ||||||||||||||||