Report an Error

NVIDIA H100 PCIe 96 GB

Graphics Processor
GH100
Cores
16896
TMUs
528
ROPs
24
Memory Size
96 GB
Memory Type
HBM3
Bus Width
5120 bit
GPU Chip
GPU
The H100 PCIe 96 GB is a professional graphics card by NVIDIA, launched on March 21st, 2023. Built on the 5 nm process, and based on the GH100 graphics processor, the card does not support DirectX. Since H100 PCIe 96 GB does not support DirectX 11 or DirectX 12, it might not be able to run all the latest games. The GH100 graphics processor is a large chip with a die area of 814 mm² and 80,000 million transistors. It features 16896 shading units, 528 texture mapping units, and 24 ROPs. Also included are 528 tensor cores which help improve the speed of machine learning applications. NVIDIA has paired 96 GB HBM3 memory with the H100 PCIe 96 GB, which are connected using a 5120-bit memory interface. The GPU is operating at a frequency of 1665 MHz, which can be boosted up to 1837 MHz, memory is running at 1313 MHz.
Being a dual-slot card, the NVIDIA H100 PCIe 96 GB draws power from an 8-pin EPS power connector, with power draw rated at 700 W maximum. This device has no display connectivity, as it is not designed to have monitors connected to it. H100 PCIe 96 GB is connected to the rest of the system using a PCI-Express 5.0 x16 interface. The card measures 268 mm in length, 111 mm in width, and features a dual-slot cooling solution.

Graphics Processor

GPU Name
GH100
Architecture
Hopper
Foundry
TSMC
Process Size
5 nm
Transistors
80,000 million
Density
98.3M / mm²
Die Size
814 mm²

Graphics Card

Release Date
Mar 21st, 2023
Generation
Tesla Hopper
(Hxx)
Predecessor
Tesla Ada
Successor
Tesla Blackwell
Production
Active
Bus Interface
PCIe 5.0 x16

Clock Speeds

Base Clock
1665 MHz
Boost Clock
1837 MHz
Memory Clock
1313 MHz
5.3 Gbps effective

Memory

Memory Size
96 GB
Memory Type
HBM3
Memory Bus
5120 bit
Bandwidth
3.36 TB/s

Render Config

Shading Units
16896
TMUs
528
ROPs
24
SM Count
132
Tensor Cores
528
L1 Cache
256 KB (per SM)
L2 Cache
50 MB

Theoretical Performance

Pixel Rate
44.09 GPixel/s
Texture Rate
969.9 GTexel/s
FP16 (half)
248.3 TFLOPS (4:1)
FP32 (float)
62.08 TFLOPS
FP64 (double)
31.04 TFLOPS (1:2)

Board Design

Slot Width
Dual-slot
Length
268 mm
10.6 inches
Width
111 mm
4.4 inches
TDP
700 W
Suggested PSU
1100 W
Outputs
No outputs
Power Connectors
8-pin EPS
Board Number
PG520

Graphics Features

DirectX
N/A
OpenGL
N/A
OpenCL
3.0
Vulkan
N/A
CUDA
9.0
Shader Model
N/A

GH100 GPU Notes

Tensor Cores: 4th Gen
NVENC: No Support
NVDEC: No Support
PureVideo HD: VP11
VDPAU: Feature Set K
Jun 12th, 2024 09:49 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts