1 | ID | Submitter | System | Processor | # | Accelerator | # | Software | Benchmark results (minutes) | Details | Code | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | Image classification | Image segmentation (medical) | Object detection, light-weight | Object detection, heavy-weight | Speech recognition | NLP | Recom- mendation | Reinforce- ment Learning | ||||||||||
3 | ImageNet | KiTS19 | COCO | COCO | LibriSpeech | Wikipedia | 1TB Clickthrough | Go | ||||||||||
4 | ResNet | 3D U-Net | SSD | Mask R-CNN | RNN-T | BERT [1] | DLRM | Minigo | ||||||||||
5 | Available cloud | |||||||||||||||||
6 | 1.1-2000 | Azure | nd96amsr_a100_v4_ngc21.09_merlin_hugectr | AMD EPYC 7V12 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | Merlin HugeCTR with NVIDIA DL Frameworks Release 21.09 | 1.875 | details | code | |||||||
7 | 1.1-2001 | Azure | nd96amsr_a100_v4_ngc21.09_mxnet | AMD EPYC 7V12 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | MXNet NVIDIA Release 21.09 | 29.720 | 25.400 | 8.309 | details | code | |||||
8 | 1.1-2002 | Azure | nd96amsr_a100_v4_ngc21.09_pytorch | AMD EPYC 7V12 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | PyTorch NVIDIA Release 21.09 | 47.064 | 37.550 | 21.213 | details | code | |||||
9 | 1.1-2003 | Azure | nd96amsr_a100_v4_ngc21.09_tensorflow | AMD EPYC 7V12 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | TensorFlow NVIDIA Release 21.09 | 319.410 | details | code | |||||||
10 | 1.1-2004 | Azure | nd96amsr_a100_v4_n4_ngc21.09_pytorch | AMD EPYC 7V12 | 8 | NVIDIA A100-SXM4-80GB (400W) | 32 | PyTorch NVIDIA Release 21.09 | 14.912 | details | code | |||||||
11 | 1.1-2005 | Azure | nd96amsr_a100_v4_n8_ngc21.09_mxnet | AMD EPYC 7V12 | 16 | NVIDIA A100-SXM4-80GB (400W) | 64 | MXNet NVIDIA Release 21.09 | 4.587 | 1.517 | details | code | ||||||
12 | 1.1-2006 | Azure | nd96amsr_a100_v4_n8_ngc21.09_pytorch | AMD EPYC 7V12 | 16 | NVIDIA A100-SXM4-80GB (400W) | 64 | PyTorch NVIDIA Release 21.09 | 3.111 | details | code | |||||||
13 | 1.1-2007 | Azure | nd96amsr_a100_v4_n9_ngc21.09_mxnet | AMD EPYC 7V12 | 18 | NVIDIA A100-SXM4-80GB (400W) | 72 | MXNet NVIDIA Release 21.09 | 3.800 | details | code | |||||||
14 | 1.1-2008 | Azure | nd96amsr_a100_v4_n16_ngc21.09_pytorch | AMD EPYC 7V12 | 32 | NVIDIA A100-SXM4-80GB (400W) | 128 | PyTorch NVIDIA Release 21.09 | 4.533 | details | code | |||||||
15 | 1.1-2009 | Azure | nd96amsr_a100_v4_n32_ngc21.09_tensorflow | AMD EPYC 7V12 | 64 | NVIDIA A100-SXM4-80GB (400W) | 256 | TensorFlow NVIDIA Release 21.09 | 30.714 | details | code | |||||||
16 | 1.1-2010 | Azure | nd96amsr_a100_v4_n34_ngc21.09_pytorch | AMD EPYC 7V12 | 68 | NVIDIA A100-SXM4-80GB (400W) | 272 | PyTorch NVIDIA Release 21.09 | 3.908 | details | code | |||||||
17 | 1.1-2011 | Azure | nd96amsr_a100_v4_n48_ngc21.09_tensorflow | AMD EPYC 7V12 | 96 | NVIDIA A100-SXM4-80GB (400W) | 384 | TensorFlow NVIDIA Release 21.09 | 24.802 | details | code | |||||||
18 | 1.1-2012 | Azure | nd96amsr_a100_v4_n96_ngc21.09_mxnet | AMD EPYC 7V12 | 192 | NVIDIA A100-SXM4-80GB (400W) | 768 | MXNet NVIDIA Release 21.09 | 1.262 | details | code | |||||||
19 | 1.1-2013 | Azure | nd96amsr_a100_v4_n128_ngc21.09_mxnet | AMD EPYC 7V12 | 256 | NVIDIA A100-SXM4-80GB (400W) | 1024 | MXNet NVIDIA Release 21.09 | 0.583 | 0.455 | details | code | ||||||
20 | 1.1-2014 | Azure | nd96amsr_a100_v4_n128_ngc21.09_pytorch | AMD EPYC 7V12 | 256 | NVIDIA A100-SXM4-80GB (400W) | 1024 | PyTorch NVIDIA Release 21.09 | 0.656 | details | code | |||||||
21 | 1.1-2015 | Azure | nd96amsr_a100_v4_n192_ngc21.09_pytorch | AMD EPYC 7V12 | 384 | NVIDIA A100-SXM4-80GB (400W) | 1536 | PyTorch NVIDIA Release 21.09 | 3.205 | details | code | |||||||
22 | 1.1-2016 | Azure | nd96amsr_a100_v4_n224_ngc21.09_tensorflow | AMD EPYC 7V12 | 448 | NVIDIA A100-SXM4-80GB (400W) | 1792 | TensorFlow NVIDIA Release 21.09 | 17.439 | details | code | |||||||
23 | 1.1-2017 | Azure | nd96amsr_a100_v4_n256_ngc21.09_mxnet | AMD EPYC 7V12 | 512 | NVIDIA A100-SXM4-80GB (400W) | 2048 | MXNet NVIDIA Release 21.09 | 0.438 | details | code | |||||||
24 | 1.1-2018 | Azure | nd96amsr_a100_v4_n256_ngc21.09_pytorch | AMD EPYC 7V12 | 512 | NVIDIA A100-SXM4-80GB (400W) | 2048 | PyTorch NVIDIA Release 21.09 | 0.422 | details | code | |||||||
25 | Available on-premise | |||||||||||||||||
26 | 1.1-2019 | Baidu | 1_node_8_A100_NGC21.05_MXNet | Intel(R) Xeon(R) Platinum 8350C | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | MXNet NVIDIA Release 21.05 | 28.605 | details | code | |||||||
27 | 1.1-2020 | Baidu | 1_node_8_A100_PaddlePaddle | Intel(R) Xeon(R) Platinum 8350C | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | PaddlePaddle (branch: develop, commitID: 605e7f0) | 28.613 | details | code | |||||||
28 | 1.1-2021 | Dell | DSS8440x8A100-PCIE-40GB | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 2 | NVIDIA A100-PCIE-40GB (250W) | 8 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 38.871 | 11.193 | 61.505 | 66.631 | 393.431 | details | code | |||
29 | 1.1-2022 | Dell | DSS8440x8A100-PCIE-40GB-NVBridge | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 2 | NVIDIA A100-PCIE-40GB (250W) | 8 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 37.083 | 10.899 | 58.571 | 405.424 | details | code | ||||
30 | 1.1-2023 | Dell | R750xax4A100-PCIE-80GB | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | 2 | NVIDIA A100-PCIE-80GB (300W) | 4 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 62.949 | 60.586 | 18.321 | 93.134 | 84.025 | 56.260 | 590.009 | details | code | |
31 | 1.1-2024 | Dell | R750xax4A100-PCIE-80GB-8368 | Intel(R) Xeon(R) Platinum 8368 CPU @ 2.40GHz | 2 | NVIDIA A100-PCIE-80GB (300W) | 4 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 64.131 | 18.390 | 91.562 | 56.131 | details | code | ||||
32 | 1.1-2025 | Dell | 2xR750xax4A100-PCIE-80GB | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | 4 | NVIDIA A100-PCIE-80GB (300W) | 8 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 32.087 | details | code | |||||||
33 | 1.1-2026 | Dell | DSS8440x8A100-PCIE-80GB | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 2 | NVIDIA A100-PCIE-80GB (300W) | 8 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 33.553 | 28.543 | 9.835 | 55.033 | 60.763 | 41.269 | details | code | ||
34 | 1.1-2027 | Dell | DSS8440x10A100-PCIE-80GB | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | 2 | NVIDIA A100-PCIE-80GB (300W) | 10 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 28.187 | 8.223 | 46.948 | 36.859 | details | code | ||||
35 | 1.1-2028 | Dell | 4xR750xax4A100-PCIE-80GB | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | 8 | NVIDIA A100-PCIE-80GB (300W) | 16 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 17.336 | details | code | |||||||
36 | 1.1-2029 | Dell | 8xR750xax4A100-PCIE-80GB | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | 16 | NVIDIA A100-PCIE-80GB (300W) | 32 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 10.586 | 3.477 | details | code | ||||||
37 | 1.1-2030 | Dell | XE8545x4A100-SXM-40GB | AMD EPYC 7763 64-Core Processor | 2 | NVIDIA A100-SXM4-40GB (400W) | 4 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 61.820 | 16.998 | 95.157 | 79.563 | details | code | ||||
38 | 1.1-2031 | Dell | XE8545x4A100-SXM-80GB | AMD EPYC 7713 64-Core Processor | 2 | NVIDIA A100-SXM4-80GB (500W) | 4 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 56.326 | 55.999 | 16.244 | 83.774 | 106.542 | 38.855 | 9.522 | 451.293 | details | code |
39 | 1.1-2032 | Dell | 2xXE8545x4A100-SXM-80GB | AMD EPYC 7713 64-Core Processor | 4 | NVIDIA A100-SXM4-80GB (500W) | 8 | NGC MXNet 21.09 , NGC PyTorch 21.09 , NGC TensorFlow 21.09-tf1 | 30.123 | 8.735 | 48.788 | 35.068 | 26.547 | details | code | |||
40 | 1.1-2033 | Fujitsu | PRIMERGY-GX2460M1-mxnet | AMD EPYC 7502 32-Core Processor | 2 | NVIDIA A100-PCIe-40GB (250W) | 4 | MXNet NGC21.09 | 70.294 | 49.946 | 20.916 | details | code | |||||
41 | 1.1-2034 | Fujitsu | PRIMERGY-GX2460M1-pytorch | AMD EPYC 7502 32-Core Processor | 2 | NVIDIA A100-PCIe-40GB (250W) | 4 | Pytorch NGC21.09 | 109.216 | 127.843 | details | code | ||||||
42 | 1.1-2035 | GIGABYTE | GIGABYTE-G492_ID0_A100-SXM-80GBx8 | Intel Xeon Platinum 8362 | 2 | NVIDIA A100-SXM-80GB (400W) | 8 | Merlin HugeCTR with NVIDIA DL Frameworks Release 21.09 | 2.098 | details | code | |||||||
43 | 1.1-2036 | GIGABYTE | GIGABYTE-G492_ID0_A100-SXM-80GBx8 | Intel Xeon Platinum 8362 | 2 | NVIDIA A100-SXM-80GB (400W) | 8 | MXNet NVIDIA Release 21.09 | 28.475 | 24.567 | 8.232 | details | code | |||||
44 | 1.1-2037 | GIGABYTE | GIGABYTE-G492_ID0_A100-SXM-80GBx8 | Intel Xeon Platinum 8362 | 2 | NVIDIA A100-SXM-80GB (400W) | 8 | PyTorch NVIDIA Release 21.09 | 46.128 | 47.728 | 39.208 | details | code | |||||
45 | 1.1-2038 | GIGABYTE | GIGABYTE-G492_ID0_A100-SXM-80GBx8 | Intel Xeon Platinum 8362 | 2 | NVIDIA A100-SXM-80GB (400W) | 8 | TensorFlow NVIDIA Release 21.09 | 303.075 | details | code | |||||||
46 | 1.1-2039 | Graphcore | IPU-POD16 | AMD EPYC 7742 | 2 | Graphcore IPU GC200 | 16 | PopART Poplar SDK 2.3.0 | 32.697 | details | code | |||||||
47 | 1.1-2040 | Graphcore | IPU-POD16 | AMD EPYC 7742 | 2 | Graphcore IPU GC200 | 16 | TensorFlow 1.15 Poplar SDK 2.3.0 | 28.335 | details | code | |||||||
48 | 1.1-2041 | Graphcore | IPU-POD64 | AMD EPYC 7742 | 2 | Graphcore IPU GC200 | 64 | PopART Poplar SDK 2.3.0 | 10.564 | details | code | |||||||
49 | 1.1-2042 | Graphcore | IPU-POD64 | AMD EPYC 7742 | 8 | Graphcore IPU GC200 | 64 | TensorFlow 1.15 Poplar SDK 2.3.0 | 8.504 | details | code | |||||||
50 | 1.1-2043 | Graphcore | IPU-POD128 | AMD EPYC 7742 | 4 | Graphcore IPU GC200 | 128 | PopART Poplar SDK 2.3.0 | 6.859 | details | code | |||||||
51 | 1.1-2044 | Graphcore | IPU-POD128 | AMD EPYC 7742 | 16 | Graphcore IPU GC200 | 128 | TensorFlow 1.15 Poplar SDK 2.3.0 | 5.672 | details | code | |||||||
52 | 1.1-2045 | Graphcore | IPU-POD256 | AMD EPYC 7742 | 32 | Graphcore IPU GC200 | 256 | TensorFlow 1.15 Poplar SDK 2.3.0 | 3.795 | details | code | |||||||
53 | 1.1-2046 | HPE | HPE-ProLiant-XL675d-Gen10-Plus_A100-SXM4-80GB_mxnet | AMD EPYC 7543 32-Core Processor | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | MXNet NVIDIA Release 21.09 | 28.807 | 26.042 | 8.334 | details | code | |||||
54 | 1.1-2047 | HPE | HPE-ProLiant-XL675d-Gen10-Plus_A100-SXM4-80GB_pytorch | AMD EPYC 7543 32-Core Processor | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | Pytorch NVIDIA Release 21.09 | 47.041 | 46.434 | details | code | ||||||
55 | 1.1-2048 | Inspur | NF5488A5 | AMD EPYC 7713 64-Core Processor | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | hugectr | 1.715 | details | code | |||||||
56 | 1.1-2049 | Inspur | NF5688M6 | Intel(R) Xeon(R) Platinum 8358 | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | hugectr | 1.698 | details | code | |||||||
57 | 1.1-2050 | Inspur | NF5488A5 | AMD EPYC 7713 64-Core Processor | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | mxnet | 27.568 | 7.979 | details | code | ||||||
58 | 1.1-2051 | Inspur | NF5688M6 | Intel(R) Xeon(R) Platinum 8358 | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | mxnet | 27.609 | 23.464 | 8.012 | details | code | |||||
59 | 1.1-2052 | Inspur | NF5488A5 | AMD EPYC 7713 64-Core Processor | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | PyTorch | 46.050 | 33.377 | 19.899 | details | code | |||||
60 | 1.1-2053 | Inspur | NF5688M6 | Intel(R) Xeon(R) Platinum 8358 | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | PyTorch | 45.667 | 19.389 | details | code | ||||||
61 | 1.1-2054 | Inspur | NF5488A5 | AMD EPYC 7713 64-Core Processor | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | tensorflow | 265.780 | details | code | |||||||
62 | 1.1-2055 | Intel-HabanaLabs | HLS-1H-N2 | Intel Xeon Platinum 8280 | 4 | Habana Gaudi | 8 | TensorFlow 2.5.1 | 56.130 | 80.475 | details | code | ||||||
63 | 1.1-2056 | Intel-HabanaLabs | HLS-1H-N4 | Intel Xeon Platinum 8280 | 8 | Habana Gaudi | 16 | TensorFlow 2.5.1 | 33.256 | 42.294 | details | code | ||||||
64 | 1.1-2057 | Intel-HabanaLabs | HLS-1H-N8 | Intel Xeon Platinum 8280 | 16 | Habana Gaudi | 32 | TensorFlow 2.5.1 | 17.382 | 21.282 | details | code | ||||||
65 | 1.1-2058 | Intel-HabanaLabs | HLS-1H-N16 | Intel Xeon Platinum 8280 | 32 | Habana Gaudi | 64 | TensorFlow 2.5.1 | 9.479 | 11.869 | details | code | ||||||
66 | 1.1-2059 | Intel-HabanaLabs | HLS-1H-N32 | Intel Xeon Platinum 8280 | 64 | Habana Gaudi | 128 | TensorFlow 2.5.1 | 5.409 | details | code | |||||||
67 | 1.1-2060 | Intel-HabanaLabs | HLS-1H-N64 | Intel Xeon Platinum 8280 | 128 | Habana Gaudi | 256 | TensorFlow 2.5.1 | 3.386 | details | code | |||||||
68 | 1.1-2061 | Lenovo | Lenovo ThinkSystem SR670 V2 Server with 8x 80GB PCIe A100 | Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 2 | NVIDIA A100-PCIE-80GB (300W) | 8 | NGC MXNet 20211013 | 32.302 | 29.848 | 9.353 | 53.170 | 46.512 | 37.369 | details | code | ||
69 | 1.1-2062 | Lenovo | Lenovo ThinkSystem SR670 V2 Server with 4x 80GB SXM4 A100 | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz | 2 | NVIDIA A100-SXM4-80GB (500W) | 4 | NGC MXNet 20211013 | 56.233 | 16.394 | 86.778 | 99.083 | 40.795 | details | code | |||
70 | 1.1-2063 | Lenovo | Lenovo ThinkSystem SD650-N V2 Server 80GB/500W A100 | Intel(R) Xeon(R) Platinum 8368 CPU @ 2.40GHz | 2 | NVIDIA A100-SXM4-80GB (500W) | 4 | NGC MXNet 21.05 | 56.193 | 16.044 | 86.401 | details | code | |||||
71 | 1.1-2064 | NVIDIA | dgxa100_ngc21.09_merlin_hugectr | AMD EPYC 7742 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | merlin_hugectr NVIDIA Release 21.09 | 1.709 | details | code | |||||||
72 | 1.1-2065 | NVIDIA | dgxa100_ngc21.09_mxnet | AMD EPYC 7742 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | MxNet NVIDIA Release 21.09 | 29.147 | 25.524 | 8.258 | details | code | |||||
73 | 1.1-2066 | NVIDIA | dgxa100_ngc21.09_pytorch | AMD EPYC 7742 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | PyTorch NVIDIA Release 21.09 | 46.167 | 34.243 | 20.003 | details | code | |||||
74 | 1.1-2067 | NVIDIA | dgxa100_ngc21.09_tensorflow | AMD EPYC 7742 | 2 | NVIDIA A100-SXM4-80GB (400W) | 8 | TensorFlow NVIDIA Release 21.09 | 264.868 | details | code | |||||||
75 | 1.1-2068 | NVIDIA | dgxa100_n4_ngc21.09_pytorch | AMD EPYC 7742 | 8 | NVIDIA A100-SXM4-80GB (400W) | 32 | PyTorch NVIDIA Release 21.09 | 14.499 | details | code | |||||||
76 | 1.1-2069 | NVIDIA | dgxa100_n8_ngc21.09_merlin_hugectr | AMD EPYC 7742 | 16 | NVIDIA A100-SXM4-80GB (400W) | 64 | merlin_hugectr NVIDIA Release 21.09 | 0.685 | details | code | |||||||
77 | 1.1-2070 | NVIDIA | dgxa100_n8_ngc21.09_mxnet | AMD EPYC 7742 | 16 | NVIDIA A100-SXM4-80GB (400W) | 64 | MxNet NVIDIA Release 21.09 | 4.534 | 1.524 | details | code | ||||||
78 | 1.1-2071 | NVIDIA | dgxa100_n8_ngc21.09_pytorch | AMD EPYC 7742 | 16 | NVIDIA A100-SXM4-80GB (400W) | 64 | PyTorch NVIDIA Release 21.09 | 3.038 | details | code | |||||||
79 | 1.1-2072 | NVIDIA | dgxa100_n9_ngc21.09_mxnet | AMD EPYC 7742 | 18 | NVIDIA A100-SXM4-80GB (400W) | 72 | MxNet NVIDIA Release 21.09 | 3.757 | details | code | |||||||
80 | 1.1-2073 | NVIDIA | dgxa100_n14_ngc21.09_merlin_hugectr | AMD EPYC 7742 | 28 | NVIDIA A100-SXM4-80GB (400W) | 112 | merlin_hugectr NVIDIA Release 21.09 | 0.633 | details | code | |||||||
81 | 1.1-2074 | NVIDIA | dgxa100_n16_ngc21.09_pytorch | AMD EPYC 7742 | 32 | NVIDIA A100-SXM4-80GB (400W) | 128 | PyTorch NVIDIA Release 21.09 | 4.408 | details | code | |||||||
82 | 1.1-2075 | NVIDIA | dgxa100_n32_ngc21.09_tensorflow | AMD EPYC 7742 | 64 | NVIDIA A100-SXM4-80GB (400W) | 256 | TensorFlow NVIDIA Release 21.09 | 29.093 | details | code | |||||||
83 | 1.1-2076 | NVIDIA | dgxa100_n51_ngc21.09_pytorch | AMD EPYC 7742 | 102 | NVIDIA A100-SXM4-80GB (400W) | 408 | PyTorch NVIDIA Release 21.09 | 3.242 | details | code | |||||||
84 | 1.1-2077 | NVIDIA | dgxa100_n96_ngc21.09_mxnet | AMD EPYC 7742 | 192 | NVIDIA A100-SXM4-80GB (400W) | 768 | MxNet NVIDIA Release 21.09 | 1.373 | details | code | |||||||
85 | 1.1-2078 | NVIDIA | dgxa100_n128_ngc21.09_mxnet | AMD EPYC 7742 | 256 | NVIDIA A100-SXM4-80GB (400W) | 1024 | MxNet NVIDIA Release 21.09 | 0.575 | 0.454 | details | code | ||||||
86 | 1.1-2079 | NVIDIA | dgxa100_n128_ngc21.09_pytorch | AMD EPYC 7742 | 256 | NVIDIA A100-SXM4-80GB (400W) | 1024 | PyTorch NVIDIA Release 21.09 | 0.558 | details | code | |||||||
87 | 1.1-2080 | NVIDIA | dgxa100_n192_ngc21.09_pytorch | AMD EPYC 7742 | 384 | NVIDIA A100-SXM4-80GB (400W) | 1536 | PyTorch NVIDIA Release 21.09 | 2.375 | details | code | |||||||
88 | 1.1-2081 | NVIDIA | dgxa100_n224_ngc21.09_tensorflow | AMD EPYC 7742 | 448 | NVIDIA A100-SXM4-80GB (400W) | 1792 | TensorFlow NVIDIA Release 21.09 | 15.465 | details | code | |||||||
89 | 1.1-2082 | NVIDIA | dgxa100_n540_ngc21.09_mxnet | AMD EPYC 7742 | 1080 | NVIDIA A100-SXM4-80GB (400W) | 4320 | MxNet NVIDIA Release 21.09 | 0.347 | details | code | |||||||
90 | 1.1-2083 | NVIDIA | dgxa100_n540_ngc21.09_pytorch | AMD EPYC 7742 | 1080 | NVIDIA A100-SXM4-80GB (400W) | 4320 | PyTorch NVIDIA Release 21.09 | 0.226 | details | code | |||||||
91 | 1.1-2084 | Supermicro | AS-2124GQ-NART+ | AMD EPYC 7H12 | 2 | NVIDIA A100-SXM4-80GB (400W) | 4 | MXNet NVIDIA Release 21.09 | 56.311 | 51.935 | 16.428 | 87.270 | 112.535 | 65.501 | 3.363 | details | code | |
92 | 1.1-2085 | Supermicro | SYS-420GP-TNAR | Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz | 2 | NVIDIA A100-SXM4-80GB (500W) | 8 | 28.005 | 25.267 | 8.015 | 47.582 | 51.077 | 36.448 | 2.157 | details | code |
1 | ID | Submitter | System | Processor | # | Accelerator | # | Software | Why in Open division? | Benchmark results (minutes) | Details | Code | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | Image classification | Image segmentation (medical) | Object detection, light-weight | Object detection, heavy-weight | Speech recognition | NLP | Recom- mendation | Reinforce- ment Learning | |||||||||||
3 | ImageNet | KiTS19 | COCO | COCO | LibriSpeech | Wikipedia | 1TB Clickthrough | Go | |||||||||||
4 | ResNet | 3D U-Net | SSD | Mask R-CNN | RNN-T | BERT [1] | DLRM | Minigo | |||||||||||
5 | Available cloud | ||||||||||||||||||
6 | 1.1-2086 | tpu-v4-4096 | AMD EPYC 7B12 | 1024 | TPU-v4 | 2048 | Lingvo-TF, https://github.com/tensorflow/lingvo.git, branch lingvo_mlperf_1.1 | see briefing material | 1196.638 * | details | code | ||||||||
7 | Available on-premise | ||||||||||||||||||
8 | 1.1-2087 | Graphcore | IPU-POD128 | AMD EPYC 7742 | 4 | Graphcore IPU GC200 | 128 | PopART Poplar SDK 2.3.0 | see briefing material | 5.879 | details | code | |||||||
9 | 1.1-2088 | Graphcore | IPU-POD16 | AMD EPYC 7742 | 2 | Graphcore IPU GC200 | 16 | PopART Poplar SDK 2.3.0 | see briefing material | 26.050 | details | code | |||||||
10 | 1.1-2089 | Graphcore | IPU-POD64 | AMD EPYC 7742 | 2 | Graphcore IPU GC200 | 64 | PopART Poplar SDK 2.3.0 | see briefing material | 8.254 | details | code | |||||||
11 | Research, development, or internal | ||||||||||||||||||
12 | 1.1-2090 | tpu-v4-2048 | AMD Rome | 512 | TPU-v4 | 1024 | Lingvo-JAX | see briefing material | 828.208 | details | code | ||||||||
13 | 1.1-2091 | Samsung | samsung_supercomputer21_dgxa100_n128_pytorch | AMD EPYC 7543 | 256 | NVIDIA A100-SXM4-80GB (400W) | 1024 | PyTorch NVIDIA Release 21.08 | see briefing material | 0.418 | details | code | |||||||
14 | * This result was linearly scaled from the submission run timing to account for the speculative location of the starting checkpoint. Adjustment was necessary to avoid multiple additional full training runs of such large NLP models. |