• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA to Stick to Monolithic GPU Dies for its GeForce "Blackwell" Generation

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
46,696 (7.66/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
NVIDIA's GeForce "Blackwell" generation of gaming GPUs will stick to being traditional monolithic die chips. The company will not build its next generation of chips as either disaggregated devices, or multi-chip modules. Kopite7kimi, a reliable source with NVIDIA leaks, says that the largest GPU in the generation, the "GB202," is based on a physically monolithic design. The GB202 is expected to power the flagship GeForce RTX 5090 (or RTX 4090 successor), and if NVIDIA sticking to traditional chip design for this, then it's unlikely that smaller GPUs will be any different.

In contrast, AMD started building disaggregated devices with its current RDNA 3 generation, with its top two chips, the "Navi 31" and "Navi 32," being disaggregated chips. An interesting rumor suggests that team red's RDNA 4 generation will see a transition from disaggregated chips to multi-chip modules—packages that contain multiple fully-integrated GPU dies. Back to the green camp, and NVIDIA is expected to use an advanced 4 nm-class node for its GeForce "Blackwell" GPUs.



View at TechPowerUp Main Site | Source
 
Joined
Apr 19, 2018
Messages
1,072 (0.48/day)
Processor AMD Ryzen 9 5950X
Motherboard Asus ROG Crosshair VIII Hero WiFi
Cooling Arctic Liquid Freezer II 420
Memory 32Gb G-Skill Trident Z Neo @3806MHz C14
Video Card(s) MSI GeForce RTX2070
Storage Seagate FireCuda 530 1TB
Display(s) Samsung G9 49" Curved Ultrawide
Case Cooler Master Cosmos
Audio Device(s) O2 USB Headphone AMP
Power Supply Corsair HX850i
Mouse Logitech G502
Keyboard Cherry MX
Software Windows 11
So, if it's an old-fashioned monolithic die, then it's only half what the GB202 they have shown for the datacenter, as that's two dies glued together. So does that mean the 5090 will have a GB203 die?

Looks like the consumers are getting the shaft yet again, unless the 5080 gets the GB203 die as well, I suppose.

The performance uplift over Lovelace will be interesting with this series, as to me it sounds like a lot of overclocking is going to be needed to bring the big performance gains to these cards. Maybe 600w+ 5090s will be a thing, and 350w 5080s etc...?
 
Last edited:
Joined
Aug 26, 2021
Messages
304 (0.30/day)
So, if it's an old-fashioned monolithic die, then it's only half what the GB202 they have shown for the datacenter. So that means the 5090 will be a GB203 die?

Looks like the consumers are getting the shaft yet again, unless the 5080 gets the GB203 die as well, I suppose.

The performance uplift over Lovelace will be interesting with this series, as to me it sounds like a lot of overclocking is needed to bring big gains to these cards. Maybe 600w 5090s are a thing, and 350w 5080s etc...?
It's always safe to assume the customer is getting shafted by Nvidia these days.
I used to be so excited for new generation of GPU and CPU but I just can't anymore the pricing is leaving such a bad taste in my mouth I just buy peripherals or add to my water cooling. Honestly consoles never looked better.
 
Joined
Oct 19, 2022
Messages
26 (0.04/day)
Location
Los Angeles, CA
Processor AMD Ryzen 9 5900X (OC)
Motherboard ASUS ROG Strix X570-E GAMING
Cooling ARCTIC Liquid Freezer II 280 A-RGB
Memory 4x8GB (32GB) G.Skill Trident Z Royal Gold @ 3733MHz CL14 (14-14-14-28)
Video Card(s) MSI GeForce RTX 4090 SUPRIM Liquid X
Storage Samsung 990 PRO 2TB w/ Heatsink SSD + Seagate FireCuda 530 SSD 2TB w/ Heatsink
Display(s) LG OLED C9 55" (4K@120Hz 12-bit RGB with G-SYNC)
Case CoolerMaster H500M (Mesh)
Audio Device(s) AKG N90Q with AudioQuest DragonFly Red (USB DAC)
Power Supply Corsair AX1500i (1500W 80+ Titanium)
Mouse Logitech G PRO X SUPERLIGHT
Keyboard Razer BlackWidow V3 Pro
Software Windows 10 64-bit
The real performance increase will probably come from the 512-bit bus w/ GDDR7 since the 4090 is Memory bandwidth starved! (and Blackwell will probably be much better in RT/PT too).
But if the rumors are true Nvidia might go back to 1 Generation of GPUs per year (just like it used to be with GTX GPUs back then).
 
Joined
May 20, 2020
Messages
1,315 (0.88/day)
Good choice; on-chip communication is still the fastest compared to mosaic structures.
 

wolf

Performance Enthusiast
Joined
May 7, 2007
Messages
7,888 (1.26/day)
System Name MightyX
Processor Ryzen 5800X3D
Motherboard Gigabyte X570 I Aorus Pro WiFi
Cooling Scythe Fuma 2
Memory 32GB DDR4 3600 CL16
Video Card(s) Asus TUF RTX3080 Deshrouded
Storage WD Black SN850X 2TB
Display(s) LG 42C2 4K OLED
Case Coolermaster NR200P
Audio Device(s) LG SN5Y / Focal Clear
Power Supply Corsair SF750 Platinum
Mouse Corsair Dark Core RBG Pro SE
Keyboard Glorious GMMK Compact w/pudding
VR HMD Meta Quest 3
Software case populated with Artic P12's
Benchmark Scores 4k120 OLED Gsync bliss
All that bothers me is the price, performance, specs, features and power consumption. How the sausage is made is below the waterline to a large extent, unless it's going to significantly impact the above mentioned considerations. For all the hoo haa about RDNA3 being chiplets, it didn't seem to matter all that much, at least not in a positive way for the consumers.
 
Joined
Jan 3, 2021
Messages
2,860 (2.27/day)
Location
Slovenia
Processor i5-6600K
Motherboard Asus Z170A
Cooling some cheap Cooler Master Hyper 103 or similar
Memory 16GB DDR4-2400
Video Card(s) IGP
Storage Samsung 850 EVO 250GB
Display(s) 2x Oldell 24" 1920x1200
Case Bitfenix Nova white windowless non-mesh
Audio Device(s) E-mu 1212m PCI
Power Supply Seasonic G-360
Mouse Logitech Marble trackball, never had a mouse
Keyboard Key Tronic KT2000, no Win key because 1994
Software Oldwin
The Cerebras Wafer-Scale Engine is also monolithic.
 
Joined
Dec 31, 2020
Messages
801 (0.63/day)
Processor E5-2690 v4
Motherboard VEINEDA X99
Video Card(s) 2080 Ti
Storage NE-512 KingSpec
Display(s) G27Q
Case DAOTECH X9
Power Supply SF450
GB202 is likely two GB203 mirrored and linked by 10TBs bus in the middle already prepared for the halved high NA reticle size in mind even though there's no need as all the way down to 16 angstroms does not employ the high Na wavelength yet. Or is it all EUV that gets halved from 868 to 429 is unclear but they are ready for next gen.
 
Joined
Apr 16, 2013
Messages
540 (0.13/day)
Location
Bulgaria
System Name Black Knight | White Queen
Processor Intel Core i9-10940X (28 cores) | Intel Core i7-5775C (8 cores)
Motherboard ASUS ROG Rampage VI Extreme Encore X299G | ASUS Sabertooth Z97 Mark S (White)
Cooling Noctua NH-D15 chromax.black | Xigmatek Dark Knight SD-1283 Night Hawk (White)
Memory G.SKILL Trident Z RGB 4x8GB DDR4 3600MHz CL16 | Corsair Vengeance LP 4x4GB DDR3L 1600MHz CL9 (White)
Video Card(s) ASUS ROG Strix GeForce RTX 4090 OC | KFA2/Galax GeForce GTX 1080 Ti Hall of Fame Edition
Storage Samsung 990 Pro 2TB, 980 Pro 1TB, 850 Pro 256GB, 840 Pro 256GB, WD 10TB+ (incl. VelociRaptors)
Display(s) Dell Alienware AW2721D 240Hz| ASUS PA246Q 60Hz, Samsung JU7500 48'' TV
Case Corsair 7000D AIRFLOW (Black) | NZXT ??? w/ ASUS DRW-24B1ST
Audio Device(s) ASUS Xonar Essence STX | Realtek ALC1150
Power Supply Enermax Revolution 1250W 85+ | Super Flower Leadex Gold 650W (White)
Mouse Razer Basilisk Ultimate, Razer Naga Trinity | Razer Mamba 16000
Keyboard Razer Blackwidow Chroma V2 (Orange switch) | Razer Ornata Chroma
Software Windows 10 Pro 64bit
Blackwell is looking more like stop-gap chip/generation (like Apple's M3/A17 Pro) than anything else.
 
Joined
Apr 13, 2022
Messages
1,013 (1.27/day)
So, if it's an old-fashioned monolithic die, then it's only half what the GB202 they have shown for the datacenter, as that's two dies glued together. So does that mean the 5090 will have a GB203 die?

Looks like the consumers are getting the shaft yet again, unless the 5080 gets the GB203 die as well, I suppose.

The performance uplift over Lovelace will be interesting with this series, as to me it sounds like a lot of overclocking is going to be needed to bring the big performance gains to these cards. Maybe 600w+ 5090s will be a thing, and 350w 5080s etc...?
If you want the bigger chip pay up for it. This is like saying drivers are getting screwed because you can't pay for a ferrarri.
 
Joined
Nov 6, 2016
Messages
1,623 (0.58/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10
All that bothers me is the price, performance, specs, features and power consumption. How the sausage is made is below the waterline to a large extent, unless it's going to significantly impact the above mentioned considerations. For all the hoo haa about RDNA3 being chiplets, it didn't seem to matter all that much, at least not in a positive way for the consumers.
Remember how the Radeon Fury X with HBM wasn't a "big deal", and now look at HBM....it's so valuable it can't be used in consumer cards. The first application or a new technology's isn't always guaranteed to make a big splash, but eventually it catches on to the point where we don't understand how we survived without it. Chiplets WILL happen, it's inevitable.
 
Joined
Feb 3, 2023
Messages
191 (0.38/day)
One has to remember that nVidia is now an AI/datacenter company. They don't really care about yields all that much because they still have the GPU market to eat up partially damaged chips. With how fast their main market is moving, they might have concluded that farting around with disaggregated architecture is just too slow.
 
Joined
Mar 28, 2020
Messages
1,665 (1.08/day)
It's always safe to assume the customer is getting shafted by Nvidia these days.
I used to be so excited for new generation of GPU and CPU but I just can't anymore the pricing is leaving such a bad taste in my mouth I just buy peripherals or add to my water cooling. Honestly consoles never looked better.
"These days" or its always been like this? Like Ampere for data center are produced on TSMC 7nm, but retail customers/ gamers' version are produced by Samsung on some matured node. Ultimately, data center solutions are the high margin products and will get the best. So it is not surprising.
 
Joined
Jan 14, 2019
Messages
10,349 (5.22/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
An interesting rumor suggests that team red's RDNA 4 generation will see a transition from disaggregated chips to multi-chip modules—packages that contain multiple fully-integrated GPU dies.
Actually, I've read the opposite somewhere - that RDNA 4 will be monolithic, and only RDNA 5 will return to chiplets. We'll see, I guess.

As for Blackwell, I guess Nvidia isn't ready to risk accepting or willing to iron out the shortcomings of the chiplet design (high idle power being the key). Playing it safe makes sense.
 
Joined
Sep 15, 2011
Messages
6,540 (1.40/day)
Processor Intel® Core™ i7-13700K
Motherboard Gigabyte Z790 Aorus Elite AX
Cooling Noctua NH-D15
Memory 32GB(2x16) DDR5@6600MHz G-Skill Trident Z5
Video Card(s) ZOTAC GAMING GeForce RTX 3080 AMP Holo
Storage 2TB SK Platinum P41 SSD + 4TB SanDisk Ultra SSD + 500GB Samsung 840 EVO SSD
Display(s) Acer Predator X34 3440x1440@100Hz G-Sync
Case NZXT PHANTOM410-BK
Audio Device(s) Creative X-Fi Titanium PCIe
Power Supply Corsair 850W
Mouse Logitech Hero G502 SE
Software Windows 11 Pro - 64bit
Benchmark Scores 30FPS in NFS:Rivals
Good choice; on-chip communication is still the fastest compared to mosaic structures.
Yes, but the yields are at least x2 times lower than a die half it's size ;)

If you want the bigger chip pay up for it. This is like saying drivers are getting screwed because you can't pay for a ferrarri.
Again comparing video cards with cars :laugh: :laugh: :laugh: :slap::banghead:
Again, you don't change your car every 1 or 2 years just because a new, faster model came in existence. Best comparison you can do, is with the smart phones. However, only suckers buys the exact same phone (let's call it iPhone 14, when the 3 years old model is exactly the same in all possible ways) :))
 
Joined
Apr 19, 2018
Messages
1,072 (0.48/day)
Processor AMD Ryzen 9 5950X
Motherboard Asus ROG Crosshair VIII Hero WiFi
Cooling Arctic Liquid Freezer II 420
Memory 32Gb G-Skill Trident Z Neo @3806MHz C14
Video Card(s) MSI GeForce RTX2070
Storage Seagate FireCuda 530 1TB
Display(s) Samsung G9 49" Curved Ultrawide
Case Cooler Master Cosmos
Audio Device(s) O2 USB Headphone AMP
Power Supply Corsair HX850i
Mouse Logitech G502
Keyboard Cherry MX
Software Windows 11
The real performance increase will probably come from the 512-bit bus w/ GDDR7 since the 4090 is Memory bandwidth starved! (and Blackwell will probably be much better in RT/PT too).
But if the rumors are true Nvidia might go back to 1 Generation of GPUs per year (just like it used to be with GTX GPUs back then).
I will see a 512bit bus when I actually see it, even in a so called $2000+ "gamer card".
 
Joined
Jul 13, 2016
Messages
2,962 (1.02/day)
Processor Ryzen 7800X3D
Motherboard ASRock X670E Taichi
Cooling Noctua NH-D15 Chromax
Memory 32GB DDR5 6000 CL30
Video Card(s) MSI RTX 4090 Trio
Storage Too much
Display(s) Acer Predator XB3 27" 240 Hz
Case Thermaltake Core X9
Audio Device(s) Topping DX5, DCA Aeon II
Power Supply Seasonic Prime Titanium 850w
Mouse G305
Keyboard Wooting HE60
VR HMD Valve Index
Software Win 10
Good choice; on-chip communication is still the fastest compared to mosaic structures.

CoWoS is able to provide 8.6TB/s of bandwidth: https://en.wikichip.org/wiki/tsmc/cowos

That was circa 2022, current implementation on Blackwell could be even better.

On-chip communications have a scaling issue wherein routing more and more data lines throughout the chips becomes increasingly difficult to do in an ideal maner as complexity increases. The university of Toronto did a paper studying the latency of CPUs with and without an interposer which demonstrated that as CPU core count increases so too does the benefit of having an active interposer.
 
Joined
May 3, 2018
Messages
2,451 (1.09/day)
What's the surprise. It's still on 4nm and on low-NA lithography with ~850mm^2 die size limit. They'll only move to MCM when they migrate to high-NA EUV , which means much smaller die sizes. If it's TSMC that's not until at least 2027 with A16 node IIRC.
 
Joined
Nov 4, 2023
Messages
44 (0.19/day)
It's always safe to assume the customer is getting shafted by Nvidia these days.
I used to be so excited for new generation of GPU and CPU but I just can't anymore the pricing is leaving such a bad taste in my mouth I just buy peripherals or add to my water cooling. Honestly consoles never looked better.
I would say CPU prices are really good, I remember the days when flagship consumer CPUs, such as a X6800 Core2Duo were 1000 bucks, adjusted for inflation that is $1400 dollars. Today flagship prices are basically 700 dollars.
 
Joined
Aug 26, 2021
Messages
304 (0.30/day)
I would say CPU prices are really good, I remember the days when flagship consumer CPUs, such as a X6800 Core2Duo were 1000 bucks, adjusted for inflation that is $1400 dollars. Today flagship prices are basically 700 dollars.
CPU prices are good but yeah I was thinking more motherboard prices being a joke well for X and Z series but B series are not bad at all until you start wanting features like a debug display. Motherboards are very carefully segmented to give very little until you go up in price but they are still cladding them in armour at every opportunity instead of offering better sound , more m 2 or more vrm it blows my mind. And why are decent dual Dimm boards so expensive the current motherboard situation is a joke. I've got no problem putting down money on a board I've spent 600+ on hedt boards in the past but it's got to be value so when I see motherboard manufacturers selling boards at hedt pricing for a lot less and clad in worthless armour instead of quality components yeah it makes me think these companies think I'm a fool but hey at least they got plenty of RGB for me to stare at while I try to work out why they won't boot.
 
Joined
Mar 28, 2023
Messages
100 (0.22/day)
I'm sorry for off-topic, but when should we expect 5070? Tbh I'm not sure if I should wait for the 5070 or should I buy the 4070Ti Super
 
Joined
Sep 15, 2011
Messages
6,540 (1.40/day)
Processor Intel® Core™ i7-13700K
Motherboard Gigabyte Z790 Aorus Elite AX
Cooling Noctua NH-D15
Memory 32GB(2x16) DDR5@6600MHz G-Skill Trident Z5
Video Card(s) ZOTAC GAMING GeForce RTX 3080 AMP Holo
Storage 2TB SK Platinum P41 SSD + 4TB SanDisk Ultra SSD + 500GB Samsung 840 EVO SSD
Display(s) Acer Predator X34 3440x1440@100Hz G-Sync
Case NZXT PHANTOM410-BK
Audio Device(s) Creative X-Fi Titanium PCIe
Power Supply Corsair 850W
Mouse Logitech Hero G502 SE
Software Windows 11 Pro - 64bit
Benchmark Scores 30FPS in NFS:Rivals
I'm sorry for off-topic, but when should we expect 5070? Tbh I'm not sure if I should wait for the 5070 or should I buy the 4070Ti Super
next year.
 
Joined
Jan 14, 2019
Messages
10,349 (5.22/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
CPU prices are good but yeah I was thinking more motherboard prices being a joke well for X and Z series but B series are not bad at all until you start wanting features like a debug display. Motherboards are very carefully segmented to give very little until you go up in price but they are still cladding them in armour at every opportunity instead of offering better sound , more m 2 or more vrm it blows my mind. And why are decent dual Dimm boards so expensive the current motherboard situation is a joke. I've got no problem putting down money on a board I've spent 600+ on hedt boards in the past but it's got to be value so when I see motherboard manufacturers selling boards at hedt pricing for a lot less and clad in worthless armour instead of quality components yeah it makes me think these companies think I'm a fool but hey at least they got plenty of RGB for me to stare at while I try to work out why they won't boot.
There's no reason for 95% of home users to choose anything other than a $200 B-series motherboard. Prices of Z and X series are artificially inflated to make you think you're getting 2-3x value when you're not.
 
Top