Report an Error
NVIDIA H100 PCIe 96 GB
- Graphics Processor
- GH100
- Cores
- 16896
- TMUs
- 528
- ROPs
- 24
- Memory Size
- 96 GB
- Memory Type
- HBM3
- Bus Width
- 5120 bit
GPU
The H100 PCIe 96 GB is a professional graphics card by NVIDIA, launched on March 21st, 2023. Built on the 5 nm process, and based on the GH100 graphics processor, the card does not support DirectX. Since H100 PCIe 96 GB does not support DirectX 11 or DirectX 12, it might not be able to run all the latest games. The GH100 graphics processor is a large chip with a die area of 814 mm² and 80,000 million transistors. It features 16896 shading units, 528 texture mapping units, and 24 ROPs. Also included are 528 tensor cores which help improve the speed of machine learning applications. NVIDIA has paired 96 GB HBM3 memory with the H100 PCIe 96 GB, which are connected using a 5120-bit memory interface. The GPU is operating at a frequency of 1665 MHz, which can be boosted up to 1837 MHz, memory is running at 1313 MHz.
Being a dual-slot card, the NVIDIA H100 PCIe 96 GB draws power from an 8-pin EPS power connector, with power draw rated at 700 W maximum. This device has no display connectivity, as it is not designed to have monitors connected to it. H100 PCIe 96 GB is connected to the rest of the system using a PCI-Express 5.0 x16 interface. The card measures 268 mm in length, 111 mm in width, and features a dual-slot cooling solution.
Graphics Processor
- GPU Name
-
GH100
- Architecture
- Hopper
- Foundry
- TSMC
- Process Size
- 5 nm
- Transistors
- 80,000 million
- Density
- 98.3M / mm²
- Die Size
- 814 mm²
Clock Speeds
- Base Clock
- 1665 MHz
- Boost Clock
- 1837 MHz
- Memory Clock
-
1313 MHz
5.3 Gbps effective
Memory
- Memory Size
-
96 GB
- Memory Type
- HBM3
- Memory Bus
-
5120 bit
- Bandwidth
-
3.36 TB/s
Render Config
- Shading Units
-
16896
- TMUs
-
528
- ROPs
-
24
- SM Count
-
132
- Tensor Cores
-
528
- L1 Cache
-
256 KB (per SM)
- L2 Cache
-
50 MB
Theoretical Performance
- Pixel Rate
-
44.09 GPixel/s
- Texture Rate
-
969.9 GTexel/s
- FP16 (half)
-
248.3 TFLOPS (4:1)
- FP32 (float)
-
62.08 TFLOPS
- FP64 (double)
-
31.04 TFLOPS (1:2)
Board Design
- Slot Width
- Dual-slot
- Length
- 268 mm
10.6 inches
- Width
- 111 mm
4.4 inches
- TDP
- 700 W
- Suggested PSU
- 1100 W
- Outputs
- No outputs
- Power Connectors
- 8-pin EPS
- Board Number
- PG520
Graphics Features
- DirectX
- N/A
- OpenGL
-
N/A
- OpenCL
- 3.0
- Vulkan
- N/A
- CUDA
- 9.0
- Shader Model
- N/A
GH100 GPU Notes
Tensor Cores: 4th Gen
NVENC: No Support
NVDEC: No Support
PureVideo HD: VP11
VDPAU: Feature Set K |