• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA H100 SXM Hopper GPU Pictured Up Close

AleksandarK

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,996 (1.06/day)
ServeTheHome, a tech media outlet focused on everything server/enterprise, posted an exclusive set of photos of NVIDIA's latest H100 "Hopper" accelerator. Being the fastest GPU NVIDIA ever created, H100 is made on TSMC's 4 nm manufacturing process and features over 80 billion transistors on an 814 mm² CoWoS package designed by TSMC. Complementing the massive die, we have 80 GB of HBM3 memory that sits close to the die. Pictured below, we have an SXM5 H100 module packed with VRM and power regulation. Given that the rated TDP for this GPU is 700 Watts, power regulation is a serious concern and NVIDIA managed to keep it in check.

On the back of the card, we see one short and one longer mezzanine connector that acts as a power delivery connector, different from the previous A100 GPU layout. This board model is labeled PG520 and is very close to the official renders that NVIDIA supplied us with on launch day.


View at TechPowerUp Main Site | Source
 
Yeah well, this is targeted towards HPC and they're using HBM3, so there's that...
 
The previous gen A100 also had 80GB variants too, so it isn't unprecedented.
 
Fluffmeister said:
The previous gen A100 also had 80GB variants too, so it isn't unprecedented.
Click to expand...

these things are only built for like supercomputers and large servers correct? or am I remembering wrong?
 
This thing looks like it's for slotting into cloud gaming GeForce NOW rack mounts
 
TSMC N4 node is probably just a marketing name for TSMC N5+ process?
 
I still don't understand how this device is connected... I don't even see the pins for the electrical source...
 
ArcanisGK507 said:
I still don't understand how this device is connected... I don't even see the pins for the electrical source...
Click to expand...

On the back of the card, we see one short and one longer mezzanine connector that acts as a power delivery connector
Click to expand...

The quality of the photos is quite low, there is focus loss all over the image - blur...
 
Is Hopper like Volta, that it's aimed completely for professional use?

ArcanisGK507 said:
I still don't understand how this device is connected... I don't even see the pins for the electrical source...
Click to expand...
Maybe it's wireless? :laugh:
 
These are snatched in like MXM, you can see traces (banded parts as well) alongside of screw holes, they don't plug in a computer case of the gaming form... so yeah.
 
ArcanisGK507 said:
I still don't understand how this device is connected... I don't even see the pins for the electrical source...
Click to expand...
They're covered with the molex caps
 
X71200 said:
These are snatched in like MXM, you can see traces (banded parts as well) alongside of screw holes, they don't plug in a computer case of the gaming form... so yeah.
Click to expand...
Yeah, those black covers just are over them.
 
Using tape
 
That's not a video card.

Video cards are huge, have at least three fans and lots of LEDs.

Like the RTX 4090.
 
Frank_100 said:
That's not a video card.
Click to expand...

It is not, it is a calculations accelerator. The graphics cards are also calculations accelerators but they have video signal outputs, so you can see the results of the calculations directly visually on your screen.

Frank_100 said:
Video cards are huge, have at least three fans and lots of LEDs.
Click to expand...

Not necessarily. The PCB with HBM memory can be very small and if the TDP is in check, then there would be no need for large aluminum heatsinks and fans.

Look at the Radeon R9 Nano:

1651875610567.png

AMD Radeon R9 Nano CrossFire Review | TechPowerUp
 
Last edited:
Frank_100 said:
That's not a video card.

Video cards are huge, have at least three fans and lots of LEDs.

Like the RTX 4090.
Click to expand...
We practically don't know anything about RTX 4090 yet. But yeah, it's a GPU, not a video card indeed.
 
 
That's a lot of Tabasco sauce. It's amazing how densely packed this it front and back. Gotta hand it to the engineers on this one.
 
@700 Watts TDP it doesn't need any cooling? Is it supposed to operate in a container of LN2?
 
80251 said:
@700 Watts TDP it doesn't need any cooling? Is it supposed to operate in a container of LN2?
Click to expand...
the cards looks smaller than the tanks used for ln2.
 
80251 said:
@700 Watts TDP it doesn't need any cooling? Is it supposed to operate in a container of LN2?
Click to expand...

These are intended to install on an SXM socket and their intended usage is for HPC/data crunching :)

ARF said:
Well, if you follow the leaks
Click to expand...

They contradict themselves all the time... I wouldn't take anything posted on wccf or videocardz in a pre-launch season seriously or even consider it anything beyond daydreaming, these sites take a nosedive in quality, they'll post any rubbish sent to them on DMs or Discord for clicks :nutkick:

Lenne said:
Is Hopper like Volta, that it's aimed completely for professional use?
Click to expand...

Yeah, though GV100 still had a 3D engine and was released to consumer channel even if through a meme of a limited release $3000 SKU.

This is much closer to GA100 or AMD's Arcturus and Aldebaran in nature as it's purely a compute card with no graphics output capabilities :oops:

Ada and Hopper will split NVIDIA's microarchitectures into two different ones geared at gaming and compute the same way RDNA and CDNA split, RDNA was an all new GPU meant to render graphics and little more, while CDNA took root in Vega (which was just as much of an insane accelerator as it was a bad gaming GPU), and developed from there.
 
Only 80GB?

This must be for the common folk
 
Can nvidia release a card for broad consumers without rt cores? Would save up space for rasterization. Maybe a card marketed for competitive gaming.
 
You must log in or register to reply here.
Back
Top