Wednesday, March 22nd 2023

NVIDIA Prepares H100 NVL GPUs With More Memory and SLI-Like Capability

NVIDIA has killed SLI on its graphics cards, disabling the possibility of connecting two or more GPUs to harness their power for gaming and other workloads. However, SLI is making a reincarnation today in the form of a new H100 GPU model that spots higher memory capacity and higher performance. Called the H100 NVL, the GPU is a unique edition design based on the regular H100 PCIe version. What makes the H100 HVL version so special is the boost in memory capacity, now up from 80 GB in the standard model to 94 GB in the NVL edition SKU, for a total of 188 GB of HMB3 memory, running on a 6144-bit bus. Being a special edition SKU, it is sold only in pairs, as these H100 NVL GPUs are paired together and are connected by three NVLink connectors on top. Installation requires two PCIe slots, separated by dual-slot spacing.

The performance differences between the H100 PCIe version and the H100 SXM version are now matched with the new H100 NVL, as the card features a boost in the TDP with up to 400 Watts per card, which is configurable. The H100 NVL uses the same Tensor and CUDA core configuration as the SXM edition, except it is placed on a PCIe slot and connected to another card. Being sold in pairs, OEMs can outfit their systems with either two or four pairs per certified system. You can see the specification table below, with information filled out by AnandTech. As NVIDIA says, the need for this special edition SKU is the emergence of Large Language Models (LLMs) that require significant computational power to run. "Servers equipped with H100 NVL GPUs increase GPT-175B model performance up to 12X over NVIDIA DGX A100 systems while maintaining low latency in power-constrained data center environments," noted the company.
Source: AnandTech
Add your own comment

3 Comments on NVIDIA Prepares H100 NVL GPUs With More Memory and SLI-Like Capability

#1
GunShot
Yeah, nothing really goes away but only coordinates (except for consumer use maybe so the crooks could charge extra).
Posted on Reply
#2
fancucker
Will sell like hot cakes despite the h8ers
Posted on Reply
#3
Lycanwolfen
SLI is really not dead It never was. It's just nvidia did not want gamers to have it anymore. They still supported it on all their workstation cards. See Nvidia wanted to stop gamers from buying two cheaper cards and SLI them which gave normally better results then paying for 1 high end card. I'm still running my 1080ti's in SLI and 4k gaming and it still runs great even on the newer games like doom and doom external. I have not seen a reason to upgrade to a single 4080 as of today. I'm still running them and have 16 GB total memory for gaming using the NVlink HB. Now I have talked to ppl saying SLI does not work in the newer games. Well thats a big YES and NO. The game does not have SLI in the settings this is true. But you can configure it in the Driver to use it in a game that does not support it so in turn it does work. Thats the biggest thing I ever saw with gamers and they did not know how to config SLI. I have had SLI gaming boxes since my Orginial Voodoo2's.
Posted on Reply
May 2nd, 2024 07:52 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts