NVIDIA H100 SXM Hopper GPU Pictured Up Close

AleksandarK · May 6, 2022

ServeTheHome, a tech media outlet focused on everything server/enterprise, posted an exclusive set of photos of NVIDIA's latest H100 "Hopper" accelerator. Being the fastest GPU NVIDIA ever created, H100 is made on TSMC's 4 nm manufacturing process and features over 80 billion transistors on an 814 mm² CoWoS package designed by TSMC. Complementing the massive die, we have 80 GB of HBM3 memory that sits close to the die. Pictured below, we have an SXM5 H100 module packed with VRM and power regulation. Given that the rated TDP for this GPU is 700 Watts, power regulation is a serious concern and NVIDIA managed to keep it in check.

On the back of the card, we see one short and one longer mezzanine connector that acts as a power delivery connector, different from the previous A100 GPU layout. This board model is labeled PG520 and is very close to the official renders that NVIDIA supplied us with on launch day.

View at TechPowerUp Main Site | Source

Deleted member 24505 · May 6, 2022

80GB of memory, yikes

X71200 · May 6, 2022

Yeah well, this is targeted towards HPC and they're using HBM3, so there's that...

Fluffmeister · May 6, 2022

The previous gen A100 also had 80GB variants too, so it isn't unprecedented.

Space Lynx · May 6, 2022

Fluffmeister said:
The previous gen A100 also had 80GB variants too, so it isn't unprecedented.

these things are only built for like supercomputers and large servers correct? or am I remembering wrong?

BiggieShady · May 6, 2022

This thing looks like it's for slotting into cloud gaming GeForce NOW rack mounts

ARF · May 6, 2022

TSMC N4 node is probably just a marketing name for TSMC N5+ process?

ArcanisGK507 · May 6, 2022

I still don't understand how this device is connected... I don't even see the pins for the electrical source...

ARF · May 6, 2022

ArcanisGK507 said:
I still don't understand how this device is connected... I don't even see the pins for the electrical source...

On the back of the card, we see one short and one longer mezzanine connector that acts as a power delivery connector

The quality of the photos is quite low, there is focus loss all over the image - blur...

Keullo-e · May 6, 2022

Is Hopper like Volta, that it's aimed completely for professional use?

ArcanisGK507 said:
I still don't understand how this device is connected... I don't even see the pins for the electrical source...

Maybe it's wireless? :laugh:

X71200 · May 6, 2022

These are snatched in like MXM, you can see traces (banded parts as well) alongside of screw holes, they don't plug in a computer case of the gaming form... so yeah.

KainXS · May 6, 2022

ArcanisGK507 said:
I still don't understand how this device is connected... I don't even see the pins for the electrical source...

They're covered with the molex caps

Keullo-e · May 6, 2022

X71200 said:
These are snatched in like MXM, you can see traces (banded parts as well) alongside of screw holes, they don't plug in a computer case of the gaming form... so yeah.

Yeah, those black covers just are over them.

mouacyk · May 6, 2022

Using tape

Frank_100 · May 6, 2022

That's not a video card.

Video cards are huge, have at least three fans and lots of LEDs.

Like the RTX 4090.

ARF · May 6, 2022

Frank_100 said:
That's not a video card.

It is not, it is a calculations accelerator. The graphics cards are also calculations accelerators but they have video signal outputs, so you can see the results of the calculations directly visually on your screen.

Frank_100 said:
Video cards are huge, have at least three fans and lots of LEDs.

Not necessarily. The PCB with HBM memory can be very small and if the TDP is in check, then there would be no need for large aluminum heatsinks and fans.

Look at the Radeon R9 Nano:

AMD Radeon R9 Nano CrossFire Review | TechPowerUp

Keullo-e · May 6, 2022

Frank_100 said:
That's not a video card.

Video cards are huge, have at least three fans and lots of LEDs.

Like the RTX 4090.

We practically don't know anything about RTX 4090 yet. But yeah, it's a GPU, not a video card indeed.

ARF · May 7, 2022

Lenne said:
We practically don't know anything about RTX 4090 yet. But yeah, it's a GPU, not a video card indeed.

Well, if you follow the leaks, there are some specs:

NVIDIA GeForce RTX 4090 with AD102 GPU rumored to ship with 100 TFLOPS of FP32 compute power - VideoCardz.com

NVIDIA AD102 'Ada Lovelace' & AMD Navi 31 'RDNA 3' GPUs To Be Power Chugging Beasts, Over 400W Rumored (wccftech.com)

AMD RDNA3 GPUs get new toned down specifications, Navi 31 with up to 12288 Stream Processors - VideoCardz.com

InVasMani · May 7, 2022

That's a lot of Tabasco sauce. It's amazing how densely packed this it front and back. Gotta hand it to the engineers on this one.

80251 · May 7, 2022

@700 Watts TDP it doesn't need any cooling? Is it supposed to operate in a container of LN2?

DeathtoGnomes · May 7, 2022

80251 said:
@700 Watts TDP it doesn't need any cooling? Is it supposed to operate in a container of LN2?

the cards looks smaller than the tanks used for ln2.

Dr. Dro · May 7, 2022

80251 said:
@700 Watts TDP it doesn't need any cooling? Is it supposed to operate in a container of LN2?

These are intended to install on an SXM socket and their intended usage is for HPC/data crunching

ARF said:
Well, if you follow the leaks

They contradict themselves all the time... I wouldn't take anything posted on wccf or videocardz in a pre-launch season seriously or even consider it anything beyond daydreaming, these sites take a nosedive in quality, they'll post any rubbish sent to them on DMs or Discord for clicks :nutkick:

Lenne said:
Is Hopper like Volta, that it's aimed completely for professional use?

Yeah, though GV100 still had a 3D engine and was released to consumer channel even if through a meme of a limited release $3000 SKU.

This is much closer to GA100 or AMD's Arcturus and Aldebaran in nature as it's purely a compute card with no graphics output capabilities :oops:

Ada and Hopper will split NVIDIA's microarchitectures into two different ones geared at gaming and compute the same way RDNA and CDNA split, RDNA was an all new GPU meant to render graphics and little more, while CDNA took root in Vega (which was just as much of an insane accelerator as it was a bad gaming GPU), and developed from there.

Mussels · May 7, 2022

Only 80GB?

This must be for the common folk

InVasMani · May 7, 2022

The more you buy the more you save. Will that be cash or credit?

PapaTaipei · May 7, 2022

Can nvidia release a card for broad consumers without rt cores? Would save up space for rasterization. Maybe a card marketed for competitive gaming.

Processor	3900X 4.425
Motherboard	X570 Tomahawk
Cooling	Galahad 360 push-pull
Memory	2x16gb Crucial Ballistix MAX 4400
Video Card(s)	Asus Dual 3060 Ti OC
Storage	Optane 280gb PCI-E
Display(s)	PG348Q
Case	Core X71
Audio Device(s)	ATOLL DAC 100SE, Sony DN1070 - Dali Ikon 1 MK2, Presonus Studio 192, Line 6 POD HD rack, Audix VX10
Power Supply	AX1500i
Mouse	Pulsar Xlite wireless white
Keyboard	Leopold FC980C 30g white
Software	Win 10 Pro

Processor	AMD Ryzen 7 3700X
Motherboard	MSI MAG B550 TOMAHAWK
Cooling	AMD Wraith Prism
Memory	Team Group Dark Pro 8Pack Edition 3600Mhz CL16
Video Card(s)	NVIDIA GeForce RTX 3080 FE
Storage	Kingston A2000 1TB + Seagate HDD workhorse
Display(s)	Samsung 50" QN94A Neo QLED
Case	Antec 1200
Power Supply	Seasonic Focus GX-850
Mouse	Razer Deathadder Chroma
Keyboard	Logitech UltraX
Software	Windows 11

System Name	Windows 10 64-bit Core i7 6700
Processor	Intel Core i7 6700
Motherboard	Asus Z170M-PLUS
Cooling	Corsair AIO
Memory	2 x 8 GB Kingston DDR4 2666
Video Card(s)	Gigabyte NVIDIA GeForce GTX 1060 6GB
Storage	Western Digital Caviar Blue 1 TB, Seagate Baracuda 1 TB
Display(s)	Dell P2414H
Case	Corsair Carbide Air 540
Audio Device(s)	Realtek HD Audio
Power Supply	Corsair TX v2 650W
Mouse	Steelseries Sensei
Keyboard	CM Storm Quickfire Pro, Cherry MX Reds
Software	MS Windows 10 Pro 64-bit

System Name	4K-gaming
Processor	AMD Ryzen 7 5800X up to 5.05GHz
Motherboard	Gigabyte B550M Aorus Elite
Cooling	Custom loop (CPU+GPU, 240 & 120 rads)
Memory	32GB Kingston HyperX Fury @ DDR4-3466
Video Card(s)	PowerColor RX 6700 XT Fighter OC/UV
Storage	~4TB SSD + 6TB HDD
Display(s)	Acer 27" 4K120 IPS + Lenovo 32" 4K60 IPS
Case	Corsair 4000D Airflow White
Audio Device(s)	Asus TUF H3 Wireless
Power Supply	EVGA Supernova G2 750W
Mouse	Logitech MX518
Keyboard	Roccat Vulcan 121 AIMO
VR HMD	Oculus Rift CV1
Software	Windows 11 Pro
Benchmark Scores	It runs Crysis remastered at 4K

Processor	3900X 4.425
Motherboard	X570 Tomahawk
Cooling	Galahad 360 push-pull
Memory	2x16gb Crucial Ballistix MAX 4400
Video Card(s)	Asus Dual 3060 Ti OC
Storage	Optane 280gb PCI-E
Display(s)	PG348Q
Case	Core X71
Audio Device(s)	ATOLL DAC 100SE, Sony DN1070 - Dali Ikon 1 MK2, Presonus Studio 192, Line 6 POD HD rack, Audix VX10
Power Supply	AX1500i
Mouse	Pulsar Xlite wireless white
Keyboard	Leopold FC980C 30g white
Software	Win 10 Pro

NVIDIA H100 SXM Hopper GPU Pictured Up Close

AleksandarK

News Editor

Deleted member 24505

Guest

X71200

Fluffmeister

Space Lynx

Astronaut

BiggieShady

ARF

ArcanisGK507

ARF

Keullo-e

S.T.A.R.S.

X71200

KainXS

Keullo-e

S.T.A.R.S.

mouacyk

Frank_100

ARF

Keullo-e

S.T.A.R.S.

ARF

InVasMani

80251

DeathtoGnomes

Dr. Dro

Mussels

Freshwater Moderator

InVasMani

PapaTaipei

Processor	AMD Ryzen 9 5950x, Ryzen 9 5980HX
Motherboard	MSI X570 Tomahawk
Cooling	Be Quiet Dark Rock Pro 4(With Noctua Fans)
Memory	32Gb Crucial 3600 Ballistix
Video Card(s)	Gigabyte RTX 3080, Asus 6800M
Storage	Adata SX8200 1TB NVME/WD Black 1TB NVME
Display(s)	Dell 27 Inch 165Hz
Case	Phanteks P500A
Audio Device(s)	IFI Zen Dac/JDS Labs Atom+/SMSL Amp+Rivers Audio
Power Supply	Corsair RM850x
Mouse	Logitech G502 SE Hero
Keyboard	Corsair K70 RGB Mk.2
VR HMD	Samsung Odyssey Plus
Software	Windows 10

System Name	Gentoo64 /w Cold Coffee
Processor	9900K 5.2GHz @1.312v
Motherboard	MXI APEX
Cooling	Raystorm Pro + 1260mm Super Nova
Memory	2x16GB TridentZ 4000-14-14-28-2T @1.6v
Video Card(s)	RTX 4090 LiquidX Barrow 3015MHz @1.1v
Storage	660P 1TB, 860 QVO 2TB
Display(s)	LG C1 + Predator XB1 QHD
Case	Open Benchtable V2
Audio Device(s)	SB X-Fi
Power Supply	MSI A1000G
Mouse	G502
Keyboard	G815
Software	Gentoo/Windows 10
Benchmark Scores	Always only ever very fast

System Name	Dumbass
Processor	AMD Ryzen 7800X3D
Motherboard	ASUS TUF gaming B650
Cooling	Artic Liquid Freezer 2 - 420mm
Memory	G.Skill Sniper 32gb DDR5 6000
Video Card(s)	GreenTeam 4070 ti super 16gb
Storage	Samsung EVO 500gb & 1Tb, 2tb HDD, 500gb WD Black
Display(s)	1x Nixeus NX_EDG27, 2x Dell S2440L (16:9)
Case	Phanteks Enthoo Primo w/8 140mm SP Fans
Audio Device(s)	onboard (realtek?) - SPKRS:Logitech Z623 200w 2.1
Power Supply	Corsair HX1000i
Mouse	Steeseries Esports Wireless
Keyboard	Corsair K100
Software	windows 10 H
Benchmark Scores	https://i.imgur.com/aoz3vWY.jpg?2

System Name	Project Kairi Mk. IV "Eternal Thunder"
Processor	13th Gen Intel Core i9-13900KS Special Edition
Motherboard	MSI MEG Z690 ACE (MS-7D27) BIOS 1G
Cooling	Noctua NH-D15S + NF-F12 industrialPPC-3000 w/ Thermalright BCF and NT-H1
Memory	G.SKILL Trident Z5 RGB 32GB DDR5-6800 F5-6800J3445G16GX2-TZ5RK @ 6400 MT/s 30-38-38-38-70-2
Video Card(s)	ASUS ROG Strix GeForce RTX™ 4080 16GB GDDR6X White OC Edition
Storage	1x WD Black SN750 500 GB NVMe + 4x WD VelociRaptor HLFS 300 GB HDDs
Display(s)	55-inch LG G3 OLED
Case	Cooler Master MasterFrame 700
Audio Device(s)	EVGA Nu Audio (classic) + Sony MDR-V7 cans
Power Supply	EVGA 1300 G2 1.3kW 80+ Gold
Mouse	Logitech G305 Lightspeed K/DA
Keyboard	Logitech K400 Plus
Software	Windows 10 Enterprise 22H2
Benchmark Scores	"Speed isn't life, it just makes it go faster."

System Name	Rainbow Sparkles (Power efficient, <350W gaming load)
Processor	Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard	Asus x570-F (BIOS Modded)
Cooling	Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory	2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s)	Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage	2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s)	Phillips 32 32M1N5800A (4k144), LG 32" (4K60) \| Gigabyte G32QC (2k165) \| Phillips 328m6fjrmb (2K144)
Case	Fractal Design R6
Audio Device(s)	Logitech G560 \| Corsair Void pro RGB \|Blue Yeti mic
Power Supply	Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse	Logitech G Pro wireless + Steelseries Prisma XL
Keyboard	Razer Huntsman TE ( Sexy white keycaps)
VR HMD	Oculus Rift S + Quest 2
Software	Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores	Nyooom.