1 | ARCH | COMPUTE CAP | VRAM | MEM PF | MEM SP | MHZ | CUDAs | MHZ x CUDAs | FP32 TFLOPS | TCORES | PERF AGG | ENERGY | ENPRICE | PPRICE | TPRICE | BANG4BUCK | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | RTX 3080 | Ampere | 8.6 | 10 | 0.96 | 760 | 1440 | 8704 | 1203.24 | 29.77 | 272 | 2.4 | 320 | €640 | €350 | €350 | €149 | 100% |
3 | RTX 3060 Ti | Ampere | 8.6 | 8 | 0.92 | 448 | 1410 | 4864 | 630.96 | 16.2 | 152 | 1.3 | 200 | €400 | €250 | €250 | €195 | 76% |
4 | RTX 4090 | Ada Lovelace | 8.9 | 24 | 1.24 | 1008 | 2235 | 16384 | 4540.66 | 82.6 | 512 | 6.4 | 450 | €900 | €1,500 | €1,500 | €235 | 63% |
5 | RTX 3070 Ti | Ampere | 8.6 | 8 | 0.92 | 608 | 1575 | 6144 | 890.27 | 21.75 | 192 | 1.7 | 290 | €580 | €400 | €400 | €235 | 63% |
6 | RTX 4070 Ti | Ada Lovelace | 8.9 | 12 | 1 | 504 | 2310 | 7680 | 1774.08 | 40.1 | 240 | 2.8 | 285 | €570 | €700 | €700 | €248 | 60% |
7 | RTX 3080 Ti | Ampere | 8.6 | 12 | 1 | 912 | 1365 | 10240 | 1397.76 | 34.1 | 320 | 2.7 | 350 | €700 | €700 | €700 | €256 | 58% |
8 | RTX 4070 Ti Super | Ada Lovelace | 8.9 | 16 | 1.08 | 672 | 2340 | 8448 | 2134.98 | 44.1 | 264 | 3.2 | 285 | €570 | €900 | €900 | €280 | 53% |
9 | RTX 4080 | Ada Lovelace | 8.9 | 16 | 1.08 | 716 | 2205 | 9728 | 2316.63 | 48.7 | 304 | 3.6 | 320 | €640 | €1,000 | €1,000 | €280 | 53% |
10 | RTX 4070 Super | Ada Lovelace | 8.9 | 12 | 1 | 504 | 1980 | 7168 | 1419.26 | 35.5 | 224 | 2.5 | 220 | €440 | €700 | €700 | €285 | 52% |
11 | RTX 4080 Super | Ada Lovelace | 8.9 | 16 | 1.08 | 736 | 2295 | 10240 | 2538.09 | 52.2 | 320 | 3.8 | 320 | €640 | €1,100 | €1,100 | €287 | 52% |
12 | RTX 3090 | Ampere | 8.6 | 24 | 1.24 | 936 | 1395 | 10496 | 1815.60 | 35.58 | 328 | 3.0 | 350 | €700 | €900 | €900 | €296 | 50% |
13 | RTX 4070 | Ada Lovelace | 8.9 | 12 | 1 | 504 | 1920 | 5888 | 1130.50 | 29.2 | 184 | 2.0 | 285 | €570 | €600 | €600 | €300 | 49% |
14 | RTX 3090 Ti | Ampere | 8.6 | 24 | 1.24 | 1008 | 1560 | 10752 | 2079.87 | 40 | 336 | 3.3 | 450 | €900 | €1,200 | €1,200 | €361 | 41% |
15 | RTX 3070 | Ampere | 8.6 | 8 | 0.92 | 448 | 1500 | 5888 | 812.54 | 20.31 | 184 | 1.6 | 220 | €440 | €600 | €600 | €376 | 40% |
16 | RTX A5000 | Ampere | 8.6 | 24 | 1.24 | 768 | 1170 | 8192 | 1188.50 | 27.8 | 256 | 2.2 | 230 | €460 | €1,500 | €2,200 | €669 | 22% |
17 | RTX A4000 | Ampere | 8.6 | 16 | 1.08 | 448 | 735 | 6144 | 487.71 | 19.1 | 192 | 1.4 | 140 | €280 | €1,000 | €1,000 | €709 | 21% |
18 | RTX 4000 Ada | Ada Lovelace | 8.9 | 20 | 1.16 | 280 | 1290 | 6144 | 919.39 | 19.2 | 192 | 1.7 | 70 | €140 | €1,250 | €1,250 | €754 | 20% |
19 | L20 | Ada Lovelace | 8.9 | 48 | 1.72 | 864 | 1440 | 11776 | 2916.68 | 59.3 | 368 | 4.4 | 275 | €550 | €5,000 | €5,000 | €1,139 | 13% |
20 | RTX 6000 Ada | Ada Lovelace | 8.9 | 48 | 1.72 | 960 | 915 | 18176 | 2860.54 | 91.1 | 568 | 5.8 | 300 | €600 | €7,000 | €7,000 | €1,201 | 12% |
21 | RTX 5000 Ada | Ada Lovelace | 8.9 | 32 | 1.4 | 576 | 1150 | 12800 | 2060.80 | 65.2 | 400 | 4.2 | 250 | €500 | €5,000 | €5,000 | €1,203 | 12% |
22 | L4 | Ada Lovelace | 8.9 | 24 | 1.24 | 300 | 795 | 7680 | 757.09 | 31.3 | 240 | 2.0 | 285 | €570 | €2,500 | €2,500 | €1,232 | 12% |
23 | L40 | Ada Lovelace | 8.9 | 48 | 1.72 | 864 | 735 | 18176 | 2297.81 | 90.5 | 568 | 5.5 | 300 | €600 | €9,000 | €9,000 | €1,638 | 9% |
24 | RTX A6000 | Ampere | 8.6 | 48 | 1.72 | 768 | 1410 | 10752 | 2607.58 | 38.7 | 336 | 3.6 | 300 | €600 | €6,000 | €6,000 | €1,669 | 9% |
25 | A100 | Ampere | 8.0 | 40 | 1.56 | 1555 | 1410 | 6912 | 1520.36 | 19.5 | 432 | 2.8 | 250 | €500 | €16,000 | €16,000 | €5,646 | 3% |
26 | H100 | Hopper | 9.0 | 80 | 2.36 | 2039 | 1065 | 7296 | 1833.78 | 24.1 | 456 | 3.2 | 350 | €700 | €30,000 | €30,000 | €9,351 | 2% |
27 | ||||||||||||||||||
28 | ||||||||||||||||||
29 | Color-coding | Variables | ||||||||||||||||
30 | Current Gen (Ada Lovelace) | Consumer | Workstation/server | Years of operation | 0 | |||||||||||||
31 | Previous Gen (Ampere) | Consumer | Workstation/server | Performance degredation mem bus factor | 0.02 | |||||||||||||
32 | Older Gen | Consumer | Workstation/server | Price per Watt per year | €2.00 | |||||||||||||
33 | ||||||||||||||||||
34 | ||||||||||||||||||
35 | Legend | |||||||||||||||||
36 | ARCH | GPU Architecture | ||||||||||||||||
37 | COMPUTE CAP | Compute Capability | ||||||||||||||||
38 | VRAM | Video card memory capacity | ||||||||||||||||
39 | MEM PF | Artificially calculated bottleneck factor for memory capacity; experimentally determined | ||||||||||||||||
40 | MEM SP | Memory speed in GB/s | ||||||||||||||||
41 | MHZ | Chip base clock speed | ||||||||||||||||
42 | CUDAs | Number of CUDA cores | ||||||||||||||||
43 | MHZ x CUDAs | Performance indicator 1: Base clock times the number of CUDA cores times MEM PF divided by 10000 | ||||||||||||||||
44 | FP32 TFLOPS | Performance inidcator 2: Single-precision floating point performance | ||||||||||||||||
45 | TCORES | Number of Tensor Cores | ||||||||||||||||
46 | PERG AGG | Aggregated performance: weighted average of performance indicator 1 and 2 | ||||||||||||||||
47 | ENERGY | Rated TDP as estimate of 100% load energy usage | ||||||||||||||||
48 | ENPRICE | Estimated cost of 100% operation per year | ||||||||||||||||
49 | PPRICE | Current new price or estimated second-hand price (in Europe) | ||||||||||||||||
50 | TPRICE | PPRICE + ENPRICE times "Years of operation" | ||||||||||||||||
51 | BANG4BUCK | TPRICE divided by PERF AGG |