Friday, May 6th 2022

NVIDIA H100 SXM Hopper GPU Pictured Up Close

ServeTheHome, a tech media outlet focused on everything server/enterprise, posted an exclusive set of photos of NVIDIA's latest H100 "Hopper" accelerator. Being the fastest GPU NVIDIA ever created, H100 is made on TSMC's 4 nm manufacturing process and features over 80 billion transistors on an 814 mm² CoWoS package designed by TSMC. Complementing the massive die, we have 80 GB of HBM3 memory that sits close to the die. Pictured below, we have an SXM5 H100 module packed with VRM and power regulation. Given that the rated TDP for this GPU is 700 Watts, power regulation is a serious concern and NVIDIA managed to keep it in check.

On the back of the card, we see one short and one longer mezzanine connector that acts as a power delivery connector, different from the previous A100 GPU layout. This board model is labeled PG520 and is very close to the official renders that NVIDIA supplied us with on launch day.
Source: ServeTheHome
Add your own comment

37 Comments on NVIDIA H100 SXM Hopper GPU Pictured Up Close

#26
ArcanisGK507
LenneIs Hopper like Volta, that it's aimed completely for professional use?


Maybe it's wireless? :laugh:
They already told me that the connector is hidden by the black band... there are also some images of how they go on the server... something unusual
Posted on Reply
#27
X71200
It's rackmount stuff, 4U, etc. Since it's not some mid tower ATX form, they can use anything non-standard that goes. Server boards are common to have different sizes, for instance. Such as looking like a big table with one side cut... lol.
Posted on Reply
#28
80251
@DR Dro
are the SXM socketed GPU's seen in the wikipedia page using heatpipes or water cooling?
Posted on Reply
#30
Panther_Seraphin
Last gen has both Air and Watercooling options. The Watercooling allowed another 100 Watt TDP per card but even the aircooled variants had a 400 watt TDP.
Posted on Reply
#31
InVasMani
I think a 4U case that's strictly setup for integrating radiators into for water cooling rack mount servers above and below it to serve both with water cooling would be a really nice idea. You could probably squeeze four 480mm radiators into a case with push/pull configurations that could then cool 2 to 4 systems CPU's and/or GPU's in whichever way is needed. It would be perfect for a 20U server rack to cool 4 systems at once.
Posted on Reply
#32
trsttte
PapaTaipeiCan nvidia release a card for broad consumers without rt cores? Would save up space for rasterization. Maybe a card marketed for competitive gaming.
Why!? Competitive games can already run at multiple hundred fps (like 500+ for games like CS GO for example) with the limitation being CPU
Posted on Reply
#33
dtoxic
The obvious question here is...Crysis? will it run?
Posted on Reply
#34
mashie
dtoxicThe obvious question here is...Crysis? will it run?
It won't, no video output.
Posted on Reply
#35
r9
Selling one kidney probably won't be enough.
Posted on Reply
#36
Panther_Seraphin
r9Selling one kidney probably won't be enough.
One kidney PER device may work, The other kidney/Half a liver would be for the server itself :D
Posted on Reply
#37
80251
How much are left testicles going for these days?
Posted on Reply
Add your own comment
Apr 27th, 2024 00:52 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts