• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Multi-Chip-Module Hopper GPU Rumored To Tape Out Soon

Uskompuf

Staff member
Joined
Mar 31, 2020
Messages
908 (1.88/day)
Hopper is an upcoming compute architecture from NVIDIA which will be the first from the company to feature a Multi-Chip-Module (MCM) design similar to Intel's Xe-HPC and AMD's upcoming CDNA2. The Hopper architecture has been teased for over 2 years but it would appear that it is nearing completion with a recent leak suggesting the product will tape out soon. This compute GPU will likely be manufactured on TSMC's 5 nm node and could feature two dies each with 288 Streaming Microprocessors which could theoretically provide a three-fold performance improvement over the Ampere-based NVIDIA A100. The first product to feature the GPU is expected to be the NVIDIA H100 data center accelerator which will serve as a successor to the A100 and could potentially launch in mid-2022.



View at TechPowerUp Main Site
 

qubit

Overclocked quantum bit
Joined
Dec 6, 2007
Messages
16,653 (3.34/day)
Location
Quantum Well UK
System Name Quantumville™
Processor Intel Core i7-2700K @ 4GHz
Motherboard Asus P8Z68-V PRO/GEN3
Cooling Noctua NH-D14
Memory 16GB (2 x 8GB Corsair Vengeance Black DDR3 PC3-12800 C9 1600MHz)
Video Card(s) MSI RTX 2080 SUPER Gaming X Trio
Storage Samsung 850 Pro 256GB | WD Black 4TB | WD Blue 6TB
Display(s) BenQ XL2720Z (144Hz, 3D Vision 2, 1080p) | Asus MG28UQ (4K, 60Hz, FreeSync compatible)
Case Cooler Master HAF 922
Audio Device(s) Creative Sound Blaster X-Fi Fatal1ty PCIe
Power Supply Corsair HX 850W v1
Mouse Microsoft Intellimouse Pro - Black Shadow
Keyboard Yes
Software Windows 10 Pro 64-bit
So, is this likely to make its way into graphics cards, or is it for compute only?
 
Joined
Apr 8, 2010
Messages
766 (0.19/day)
Processor Intel Core i5 8400
Motherboard Gigabyte Z370N-Wifi
Cooling Silverstone AR05
Memory Micron Crucial 16GB DDR4-2400
Video Card(s) Gigabyte GTX1080 G1 Gaming 8G
Storage Micron Crucial MX300 275GB
Display(s) Dell U2415
Case Silverstone RVZ02B
Power Supply Silverstone SSR-SX550
Keyboard Ducky One Red Switch
Software Windows 10 Pro 1909
Will this GPU be relevant for gamers?
 

64K

Joined
Mar 13, 2014
Messages
5,053 (1.88/day)
Processor i7 7700k
Motherboard MSI Z270 SLI Plus
Cooling CM Hyper 212 EVO
Memory 2 x 8 GB Corsair Vengeance
Video Card(s) MSI RTX 2070 Super
Storage Samsung 850 EVO 250 GB and WD Black 4TB
Display(s) Dell 27 inch 1440p 144 Hz
Case Corsair Obsidian 750D Airflow Edition
Audio Device(s) Onboard
Power Supply EVGA SuperNova 850 W Gold
Mouse Logitech G502
Keyboard Logitech G105
Software Windows 10
I think I recall reading that the next AMD multi-chip GPU for desktop will be coming to desktop at some point so Nvidia should make them available for Desktop gaming at some point in the future.
 
Joined
Jan 8, 2017
Messages
6,836 (4.12/day)
System Name Good enough
Processor AMD Ryzen R7 1700X - 4.0 Ghz / 1.350V
Motherboard ASRock B450M Pro4
Cooling Deepcool Gammaxx L240 V2
Memory 16GB - Corsair Vengeance LPX - 3333 Mhz CL16
Video Card(s) OEM Dell GTX 1080 with Kraken G12 + Water 3.0 Performer C
Storage 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) 4K Samsung TV
Case Deepcool Matrexx 70
Power Supply GPS-750C
I think I recall reading that the next AMD multi-chip GPU for desktop will be coming to desktop at some point so Nvidia should make them available for Desktop gaming at some point in the future.

Not these ones they wont. A100 for example is not a graphics oriented chip, it doesn't even have RT cores and neither will Hopper most likely.
 
Last edited:
Joined
Sep 17, 2014
Messages
15,011 (5.99/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) MSI GTX 1080 Gaming X @ 2100/5500
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define C TG
Audio Device(s) Situational :)
Power Supply EVGA G2 750W
Mouse Logitech G502 Protheus Spectrum
Keyboard Lenovo Thinkpad Trackpoint II (Best K/B ever... <3)
Software W10 x64
Will this GPU be relevant for gamers?

If you cash out all your ETH by then which is probably in about 2-3 years, you can then buy one to mine ETH with and in six to eight years you will get to ask the same question :)

More serious... So far this seems to just be oriented at other markets but eventually some cut down should reach us, especially if you consider the die sizes and power on current top end cards. Not much headroom there.
 
Joined
Jun 5, 2021
Messages
64 (1.21/day)
These are the same leakers that lied about the switch pro.. these are made up rumours these are not nsa level on getting intel
 
Joined
Aug 20, 2007
Messages
15,638 (3.07/day)
System Name Pioneer
Processor Ryzen R7 5800X
Motherboard GIGABYTE Aorus Elite X570
Cooling Noctua NH-D15 + A whole lotta Sunon and Corsair Maglev blower fans...
Memory G.SKILL Ripjaws V Series 64GB (4 x 16GB) DDR4-3200
Video Card(s) EVGA GeForce RTX 3070 FTW3
Storage 2x Mushkin Pilot-E 2TB NVMe SSDs
Display(s) 55" LG 55" B9 OLED 4K Display
Case Thermaltake Core X31
Audio Device(s) VGA HDMI->Panasonic SC-HTB20/Schiit Modi MB/Asgard 2 DAC/Amp to AKG Pro K7712 Headphones
Power Supply Seasonic Prime Titanium 750W
Mouse Razer Deathadder v2
Keyboard WASD CODE 104-Key w/ Cherry MX Green Keyswitches, Doubleshot Vortex PBT White Transluscent Keycaps
Software Windows 10 Enterprise (Product of work, yes it's legit)
Benchmark Scores www.3dmark.com/fs/25631365 www.3dmark.com/spy/20539287 www.3dmark.com/pr/1054199
Joined
Apr 16, 2013
Messages
316 (0.10/day)
Location
Bulgaria
System Name Black Knight | White Queen
Processor Intel Core i9-10940X | Intel Core i7-5775C
Motherboard ASUS ROG Rampage VI Extreme Encore X299G | ASUS Sabertooth Z97 Mark S (White)
Cooling Noctua NH-D15 chromax.black | Xigmatek Dark Knight SD-1283 Night Hawk (White)
Memory G.SKILL Trident Z RGB 4x8GB DDR4 3600MHz CL16 | Corsair Vengeance LP 4x4GB DDR3L 1600MHz CL9 (White)
Video Card(s) KFA2/Galax GeForce GTX 1080 Ti Hall of Fame Edition | Intel Iris Pro 6200
Storage Samsung 980 Pro 1TB, 850 Pro 256GB, 840 Pro 256GB, WD Red 2/3/6TB, WD VelociRaptor 300GB/600GB/1TB
Display(s) ASUS ROG Strix XG279Q 27'', PA246Q 24'' (10 bit, CCFL, 12 bit LUT, P-IPS) | Samsung JU7500 48'' TV
Audio Device(s) ASUS Xonar Essence STX | Realtek ALC1150
Power Supply Enermax Revolution 1250W 85+ | Super Flower Leadex Gold 650W (White)
Mouse Razer Basilisk Ultimate, Razer Naga Trinity | Razer Mamba 16000
Keyboard Razer Blackwidow Chroma V2 (Orange switch) | Razer Ornata Chroma
Software Windows 10 Pro 64bit
Benchmark Scores The G.Skill is with Samsung B-die chips.
Most people which aren't able to snap Ampere on this point, will get at least fresh RTX 4****s.
 
Joined
Jun 22, 2014
Messages
348 (0.13/day)
System Name Desktop / "Console"
Processor Ryzen 5950X / Ryzen 5800X
Motherboard Asus X570 Hero / Asus X570-i
Cooling Deepcool Castle 280X / Cryorig C1
Memory 32GB Gskill Trident DDR4-3600 CL16 / 16GB Crucial Ballistix DDR4-3600 CL16
Video Card(s) RTX 3090 FE / RTX 2080ti FE
Storage 1TB Samsung 980 Pro, 1TB Sabrent Rocket 4 Plus NVME / 1TB Sabrent Rocket 4 NVME, 1TB Intel 660P
Display(s) LG 34GK950F / LG 65CX Oled
Case Lian Li O11 Mini / Sliger CL530 Conswole
Audio Device(s) Sony AVR, SVS Ultra Bookshelf / Marantz AVR, SVS Pinnacle, dual SB2000pro
Power Supply Silverstone SX1000 / Silverstone SX800
VR HMD Quest 2 + Airlink, Elite Strap w/ VR Cover face and strap pads
So, is this likely to make its way into graphics cards, or is it for compute only?
From my understanding it is more of a software issue (OS and game engine) that is keeping us from having MCM gpu's in the consumer space, whereas from the hardware side they will be able to make it work once the interconnect designs like Infinity Fabric or NVLink catch up to the needs of the individual cores (which, they have pretty much accomplished now). I remember reading a Q&A with Lisa Su leading up to the launch of Navi where she essentially stated this. I have looked for a bit trying to find that exact article (I thought it was here at TPU or Anandtech but I'm not having luck) and though I was not able to, here is an article interviewing David Wang from AMD that basically covers the same thing Lisa Su did. I can't recall reading about this from an nVidia designer/engineer, but I'm sure Green camp faces the exact same issue. On the topic of this article (being that Hopper is not a consumer gpu), the following link also briefly covers the fact that in compute environments the MCM limitation is different or non-existent, and it is only in gaming that the problems arise. I'll keep trying to find Lisa's response/explanation, as it was a bit more detailed.


More serious... So far this seems to just be oriented at other markets but eventually some cut down should reach us, especially if you consider the die sizes and power on current top end cards. Not much headroom there.

I too expect the day to come for MCM to trickle down to the consumer space. But it seems AMD/nVidia are more so at the mercy of Microsoft and game developers. It is a MUCH needed evolution of graphic card design for so many reasons. cost/scalability/yields/ just to name a few big ones.
 
Joined
Feb 20, 2020
Messages
2,299 (4.39/day)
Location
Texas
System Name Ghetto Rigs x299 & z490 & x99 & Q9550 Old timer
Processor 9940x w/Optimus SigV2 & 10900k w/Optimus Foundation & 5930k w/EK Magnitude & Q9550 w/EK Evo
Motherboard X299 Rampage VI Apex & z490 Maximus XII Apex & x99 Sabertooth & Acer WG43M
Cooling D5 combo/280 GTX/ VRM water block copper/280 GTX/ D5 Top/Optimus sigV2/TitanXp/Mora 360x2
Memory Trident-Z 3600C16 4x8gb & Trident-Z 3600c16 2x8gb & Trident-Z 3200c14 4x8gb & 4x2gb crucial
Video Card(s) Titan Xp & 1080ti ftw3 & evga 980ti gaming & Onboard graphic's need another gpu
Storage 970 evo plus 500gb & 970 evo 500gb many 2.5" ssd's and WD BLK hdd's
Display(s) 1-AOC G2460PG 24"G-Sync 144Hz/ 2nd 1-ASUS VG248QE 24"/ 3rd LG 43" series
Case D450 second floor for 2nd rad x2/ Cherry Entertainment center/ 2 Test benches
Audio Device(s) Built in Realtek x2 with Insignia 2.0 sound bars & 1-LG sound bar
Power Supply EVGA 1200P2 & 1000P2 with APC AX1500 & 850P2 with CyberPower-GX1325U & 1-750P2-extra
Mouse Redragon Perdition x3
Keyboard G910 & G710+x2
Software Win-7 pro x3 and Linux Cinnamon 20.1x2 & win-10 pro x3
Hi,
Tapout is like saying something is giving up so this is a poor choice of words even tape out really makes no sense
 

64K

Joined
Mar 13, 2014
Messages
5,053 (1.88/day)
Processor i7 7700k
Motherboard MSI Z270 SLI Plus
Cooling CM Hyper 212 EVO
Memory 2 x 8 GB Corsair Vengeance
Video Card(s) MSI RTX 2070 Super
Storage Samsung 850 EVO 250 GB and WD Black 4TB
Display(s) Dell 27 inch 1440p 144 Hz
Case Corsair Obsidian 750D Airflow Edition
Audio Device(s) Onboard
Power Supply EVGA SuperNova 850 W Gold
Mouse Logitech G502
Keyboard Logitech G105
Software Windows 10
It's past time for a gaming multi-chip module. We need Nvidia and AMD to make that a reality.
 
Joined
Sep 17, 2014
Messages
15,011 (5.99/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) MSI GTX 1080 Gaming X @ 2100/5500
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define C TG
Audio Device(s) Situational :)
Power Supply EVGA G2 750W
Mouse Logitech G502 Protheus Spectrum
Keyboard Lenovo Thinkpad Trackpoint II (Best K/B ever... <3)
Software W10 x64
It's past time for a gaming multi-chip module. We need Nvidia and AMD to make that a reality.
Latency though

But some sort of internal split render tech should work I suppose. But even those technologies incur a latency hit on multi GPU already.
 
Joined
Mar 21, 2016
Messages
1,074 (0.55/day)
Latency though

But some sort of internal split render tech should work I suppose. But even those technologies incur a latency hit on multi GPU already.
I could see them having a chip dedicated solely for post process which would allow for a lot of additional performance. It might be something more like a RX6800 chip with RX6600 chip combined where the RX6600 handles the post process of the rendering passed along to it by the RX6800. They could basically use a second chip for post process inference interpolation of effects with a secondary GPU to devout solely to it you can use all that overhead for it and not incur a performance dip on the primary GPU by taking away resources from it. You could be upscale post process higher and layer it more extensively with multiple configurations of the same technique layering them much like drum samples get layered in songs or similar to a SID chip.
 
Joined
Jul 10, 2015
Messages
629 (0.28/day)
Location
Sokovia
System Name Alienation from family
Processor i7 7700k
Motherboard Hero VIII
Cooling Macho revB
Memory 16gb Hyperx
Video Card(s) Asus 1080ti Strix OC
Storage 960evo 500gb
Display(s) AOC 4k
Case Define R2 XL
Power Supply Be f*ing Quiet 600W M Gold
Mouse NoName
Keyboard NoNameless HP
Software You have nothing on me
Benchmark Scores Personal record 100m sprint: 60m
Most people which aren't able to snap Ampere on this point, will get at least fresh RTX 4****s.
Imagine how much money for new graphics card will be saved till then? Good times ahead ;.)
 
Joined
Aug 23, 2013
Messages
300 (0.10/day)
Imagine how much money for new graphics card will be saved till then? Good times ahead ;.)

Jen and Lisa sure are imagining it. Everyone's taught them both that they've been WAAAAAAAY underpricing their GPU MSRP's. They tried hitting lower price points and look what happened. Everyone self-priced up. Just wait till you get a load of those new MSRP's they now realize the market can bear.

All thanks to people buying cards regardless of the price. Thanks everyone!
 
Joined
May 3, 2018
Messages
433 (0.37/day)
No, it will be compute only.
Based on what. Nvidia hasn't said squat about Hopper. No one's ever said it won't find it's way to desktop. With Lovelace in the interim, Hopper or a revision will not be needed for desktop until probably late 2023 anyway. By then RDNA4 will be on the release schedule and Nvidia will be fools not to have their all new architecture ready. Already known RDNA3 will be a very large pgrade over RDNA2 and Lovelace will have a tough job. And we might find RDNA3 has a MC design.
 
Joined
Mar 21, 2016
Messages
1,074 (0.55/day)
I think Nvidia will have a different SKU for desktop mGPU if it comes at all to desktop from this SKU it would probably be in the form of a Titan or Quadro card, but might lack tensor core hardware. Honestly that would be fine for a lot of people though especially workstation users that might not even make use of RTRT or care about the DLSS aspect which at this point why would you need to with FSR that's "close enough" even if you want to argue and debate differences between the two!!?

I think there is about a 50% chance RNDA3 is mGPU based. If it isn't I suspect the next Radeon Pro/Killer Instinct cards will be.
 
Joined
Apr 14, 2019
Messages
217 (0.26/day)
System Name Violet
Processor AMD Ryzen 5800X
Motherboard ASRock x570 Phantom Gaming X
Cooling Be quiet! Dark Rock Pro 4
Memory G.Skill Flare x 32GB 3400Mhz
Video Card(s) Sapphire RX 5700 XT Nitro+
Storage Western Digital WD Black SN750 1TB
Display(s) 3440x1440
Case Lian Li LANCOOL II MESH Performance
Power Supply Corsair RM850x
Mouse Razer NAGA TRINITY
Keyboard Corsair K95 RGB
Software Windows 10 64bit
Time will tell how it unfolds.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
12,253 (3.53/day)
Location
Concord, NH
System Name Apollo
Processor Intel Core i9 9880H
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Full Size Wireless Apple Magic Keyboard
Software MacOS 10.15.7
Latency though
That's what people said about CPUs using MCM. Those are problems to be solved, not ones to be avoided. With that said, I don't see MCM being unrealistic for GPUs. It'll just take time to get right.
 
Joined
Feb 18, 2012
Messages
2,455 (0.71/day)
System Name MSI GE75 Raider
Processor i7 10750h
Cooling 2 laptop fans
Memory 32gb of 3000mhz DDR4
Video Card(s) Nvidia 2070 super
Storage Seagate 2tb Firecuba 510 m.2, XPG SPECTRIX S40G 4tb m.2, Samsung 870 8tb ssd
Display(s) 17.3" IPS 1920x1080 144Hz
Power Supply 230w laptop power supply
Mouse Logitech m705
Keyboard laptop keyboard
Software lots of movies and Windows 10 with win 7 shell
Benchmark Scores Good enough for me
  • Haha
Reactions: hat
Top