• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD "Navi 31" Memory Cache Die Has Preparation for 3D Vertical Cache?

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
46,564 (7.66/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
AMD possibly has a straightforward path to increasing the performance of the "Navi 31" RDNA3 GPU to power future high-end SKUs, according to semiconductor engineer Tom Wassick. The GPU's main SIMD machinery is located in the Graphics Compute Die (GCD) built on the 5 nm EUV foundry process, surrounded by six Memory Cache Dies (MCDs) built on 6 nm, which each contain GDDR6 memory controllers, and a 16 MB segment of the GPU's 96 MB Infinity Cache memory.

In microscopic observations, Wassick noticed structures on the MCD which he thinks look like an array of through-silicon vias (TSVs), of the kind used in "Zen 3" and "Zen 4" CCDs, to wire out stacked 3D Vertical Cache memory on the L3D (L3 cache die). If the theory holds up, it could be possible for AMD to increase the L3 cache segment size per MCD from 16 MB, and the GPU's overall Infinity Cache memory size. With its RDNA2 graphics architecture (RX 6000 series), AMD significantly enlarged on-die caches on its GPUs, particularly the last-level L3 cache, even giving them the special branding of "Infinity Cache," claiming that they had a big impact in lubricating the memory sub-system, letting GPUs with 256-bit memory buses compete with NVIDIA GPUs with wider 320-bit to 384-bit interfaces.



View at TechPowerUp Main Site | Source
 

Space Lynx

Astronaut
Joined
Oct 17, 2014
Messages
16,495 (4.69/day)
Location
Kepler-186f
Processor Ryzen 7800X3D -30 uv
Motherboard AsRock Steel Legend B650
Cooling MSI C360 AIO
Memory T-Create 32gb 6000 CL 30-36-36-36
Video Card(s) MERC310 7900 XT -60 uv +150 core
Display(s) NZXT Canvas IPS 1440p 165hz 27"
Case NZXT H710 (Red/Black)
Audio Device(s) HD58X, Asgard 2, Modi 3
Power Supply Corsair RM850W
It will be interesting to see what the gpu market looks like two years from now.
 
Low quality post by nguyen
Joined
Nov 11, 2016
Messages
3,142 (1.14/day)
System Name The de-ploughminator Mk-II
Processor i7 13700KF
Motherboard MSI Z790 Carbon
Cooling ID-Cooling SE-226-XT + Phanteks T30
Memory 2x16GB G.Skill DDR5 7200Cas34
Video Card(s) Asus RTX4090 TUF
Storage Kingston KC3000 2TB NVME
Display(s) LG OLED CX48"
Case Corsair 5000D Air
Audio Device(s) KEF LSX II LT speakers + KEF KC62 Subwoofer
Power Supply Corsair HX850
Mouse Razor Viper Ultimate
Keyboard Corsair K75
Software win11
LOL another hyped up tech that only lead up to disapointment
 

Space Lynx

Astronaut
Joined
Oct 17, 2014
Messages
16,495 (4.69/day)
Location
Kepler-186f
Processor Ryzen 7800X3D -30 uv
Motherboard AsRock Steel Legend B650
Cooling MSI C360 AIO
Memory T-Create 32gb 6000 CL 30-36-36-36
Video Card(s) MERC310 7900 XT -60 uv +150 core
Display(s) NZXT Canvas IPS 1440p 165hz 27"
Case NZXT H710 (Red/Black)
Audio Device(s) HD58X, Asgard 2, Modi 3
Power Supply Corsair RM850W
LOL another hyped up tech that only lead up to disapointment

What makes you think that, given the success of x3d on CPU side of things?
 
Low quality post by nguyen
Joined
Nov 11, 2016
Messages
3,142 (1.14/day)
System Name The de-ploughminator Mk-II
Processor i7 13700KF
Motherboard MSI Z790 Carbon
Cooling ID-Cooling SE-226-XT + Phanteks T30
Memory 2x16GB G.Skill DDR5 7200Cas34
Video Card(s) Asus RTX4090 TUF
Storage Kingston KC3000 2TB NVME
Display(s) LG OLED CX48"
Case Corsair 5000D Air
Audio Device(s) KEF LSX II LT speakers + KEF KC62 Subwoofer
Power Supply Corsair HX850
Mouse Razor Viper Ultimate
Keyboard Corsair K75
Software win11
What makes you think that, given the success of x3d on CPU side of things?

X3D was only good because Intel was being incompetent for 4 straight years
Nvidia however never sit back and relax
 
Joined
Dec 22, 2011
Messages
3,890 (0.86/day)
Processor AMD Ryzen 7 3700X
Motherboard MSI MAG B550 TOMAHAWK
Cooling AMD Wraith Prism
Memory Team Group Dark Pro 8Pack Edition 3600Mhz CL16
Video Card(s) NVIDIA GeForce RTX 3080 FE
Storage Kingston A2000 1TB + Seagate HDD workhorse
Display(s) Samsung 50" QN94A Neo QLED
Case Antec 1200
Power Supply Seasonic Focus GX-850
Mouse Razer Deathadder Chroma
Keyboard Logitech UltraX
Software Windows 11
The cost of entry for the current cards is too high, maybe a future SKU with 3D cache and all the annoying niggles ironed out might be more appealing for the money they are asking.
 
Joined
May 2, 2022
Messages
1,307 (1.72/day)
Location
G-City, UK
System Name My first new build
Processor Ryzen 7 5700X
Motherboard MSI B450M mortar max
Cooling Deepcool AK620
Memory 32gb Corsair Vengeance LPX 3200@XMP3200
Video Card(s) Sapphire 6900XT Toxic Air Cooled
Storage Samsung 870 QVO 1TB x 2, Lexar 256 GB, Western Digital SN550 500 GB nvme
Display(s) 32" LG GN600-B
Case Aerocool Eclipse
Audio Device(s) Corsair HS70 wireless
Power Supply MSI MPG AGF 850 watt gold
Mouse Glorious Model D l Pad GameSir G7 SE
Keyboard Redragon Vara K551P
Software Windows 11
LOL another hyped up tech that only lead up to disapointment
Well, the same could be said about DLSS or Ray Tracing... But that's Nvidia, so we CAN'T do that.:)
 
Low quality post by nguyen
Joined
Nov 11, 2016
Messages
3,142 (1.14/day)
System Name The de-ploughminator Mk-II
Processor i7 13700KF
Motherboard MSI Z790 Carbon
Cooling ID-Cooling SE-226-XT + Phanteks T30
Memory 2x16GB G.Skill DDR5 7200Cas34
Video Card(s) Asus RTX4090 TUF
Storage Kingston KC3000 2TB NVME
Display(s) LG OLED CX48"
Case Corsair 5000D Air
Audio Device(s) KEF LSX II LT speakers + KEF KC62 Subwoofer
Power Supply Corsair HX850
Mouse Razor Viper Ultimate
Keyboard Corsair K75
Software win11
Well, the same could be said about DLSS or Ray Tracing... But that's Nvidia, so we CAN'T do that.:)

Even if you are ignoring what are the defining features of modern gaming, ADA is still ahead by a mile...
 
Joined
May 2, 2022
Messages
1,307 (1.72/day)
Location
G-City, UK
System Name My first new build
Processor Ryzen 7 5700X
Motherboard MSI B450M mortar max
Cooling Deepcool AK620
Memory 32gb Corsair Vengeance LPX 3200@XMP3200
Video Card(s) Sapphire 6900XT Toxic Air Cooled
Storage Samsung 870 QVO 1TB x 2, Lexar 256 GB, Western Digital SN550 500 GB nvme
Display(s) 32" LG GN600-B
Case Aerocool Eclipse
Audio Device(s) Corsair HS70 wireless
Power Supply MSI MPG AGF 850 watt gold
Mouse Glorious Model D l Pad GameSir G7 SE
Keyboard Redragon Vara K551P
Software Windows 11
Even if you are ignoring what are the defining features of modern gaming, ADA is still ahead by a mile...
Nvidia is indeed in the lead. If you love paying over the odds for a monstrous brick, that's fine. AMD seem to like letting people get the upper hand and then making a comeback.
 
Joined
Dec 22, 2011
Messages
3,890 (0.86/day)
Processor AMD Ryzen 7 3700X
Motherboard MSI MAG B550 TOMAHAWK
Cooling AMD Wraith Prism
Memory Team Group Dark Pro 8Pack Edition 3600Mhz CL16
Video Card(s) NVIDIA GeForce RTX 3080 FE
Storage Kingston A2000 1TB + Seagate HDD workhorse
Display(s) Samsung 50" QN94A Neo QLED
Case Antec 1200
Power Supply Seasonic Focus GX-850
Mouse Razer Deathadder Chroma
Keyboard Logitech UltraX
Software Windows 11
Maybe they will go back to a HBM, that was the future once for consumer cards!
 
Joined
Aug 12, 2021
Messages
45 (0.04/day)
They can already make a 7950XTX style easy without 3Dcache like they have do with the 6900 xt.

1) Switch GDDR6 20 Gbps to GDDR6X 24 Gbps chip

2) Put higher Power limite like 450W + 15% slider

3) take best binned silicone add 0.25V and a OC

That was the magical ~ bonus from a 6900 xt to 6950 xt and gain was correct for 100$ more ?
 
Joined
Sep 18, 2020
Messages
108 (0.08/day)
System Name Vedica
Processor Intel Core i7-9700K
Motherboard Gigabyte AORUS Ultra Z390
Cooling Alphacool Eisblock XPX
Memory 32GB DDR4, 4x Crucial Ballistix Sport LT BLS8G4D30AESBK
Video Card(s) Nvidia RTX 3080
Storage 2x Sabrent 1 TB Rocket - 1x Seagate Barracuda ST4000DM004
Display(s) Dell AW3423DWF
Case Fractal Design Define R6
Audio Device(s) Motu M2
Power Supply Corsair RM1000x
Mouse Cooler Master MM720
Keyboard Wooting One
Even if you are ignoring what are the defining features of modern gaming, ADA is still ahead by a mile...
So you are one of those guys playing bar charts on tech sites and scrutinizing screenshots with a magnifying glass...
Guess what? That's not gaming.
The mile you're talking about doesn't matter a inch to the average gamer because outside of bar charts there is no visible difference for the average gamer in the real world. Mind you, I'm not advocating AMD, I'm just saying that outside of technological fanaticism those percentage differences really matter little.
 
Joined
Nov 15, 2020
Messages
893 (0.69/day)
System Name 1. Glasshouse 2. Odin OneEye
Processor 1. Ryzen 9 5900X (manual PBO) 2. Ryzen 9 7900X
Motherboard 1. MSI x570 Tomahawk wifi 2. Gigabyte Aorus Extreme 670E
Cooling 1. Noctua NH D15 Chromax Black 2. Custom Loop 3x360mm (60mm) rads & T30 fans/Aquacomputer NEXT w/b
Memory 1. G Skill Neo 16GBx4 (3600MHz 16/16/16/36) 2. Kingston Fury 16GBx2 DDR5 CL36
Video Card(s) 1. Asus Strix Vega 64 2. Powercolor Liquid Devil 7900XTX
Storage 1. Corsair Force MP600 (1TB) & Sabrent Rocket 4 (2TB) 2. Kingston 3000 (1TB) and Hynix p41 (2TB)
Display(s) 1. Samsung U28E590 10bit 4K@60Hz 2. LG C2 42 inch 10bit 4K@120Hz
Case 1. Corsair Crystal 570X White 2. Cooler Master HAF 700 EVO
Audio Device(s) 1. Creative Speakers 2. Built in LG monitor speakers
Power Supply 1. Corsair RM850x 2. Superflower Titanium 1600W
Mouse 1. Microsoft IntelliMouse Pro (grey) 2. Microsoft IntelliMouse Pro (black)
Keyboard Leopold High End Mechanical
Software Windows 11
They can already make a 7950XTX style easy without 3Dcache like they have do with the 6900 xt.

1) Switch GDDR6 20 Gbps to GDDR6X 24 Gbps chip

2) Put higher Power limite like 450W + 15% slider

3) take best binned silicone add 0.25V and a OC

That was the magical ~ bonus from a 6900 xt to 6950 xt and gain was correct for 100$ more ?
They won't do that again. I think this theory on 3D cache is more likely. AMD like to show how they innovate and change up.
 
Joined
Dec 5, 2020
Messages
170 (0.13/day)
Nvidia is indeed in the lead. If you love paying over the odds for a monstrous brick, that's fine. AMD seem to like letting people get the upper hand and then making a comeback.
It's not like things are all that different with AMD. Same overpriced stuff except they're also lacking in a ton of areas.

It's one step at a time but it's clearly RT is the future.
 
Joined
Nov 11, 2016
Messages
3,142 (1.14/day)
System Name The de-ploughminator Mk-II
Processor i7 13700KF
Motherboard MSI Z790 Carbon
Cooling ID-Cooling SE-226-XT + Phanteks T30
Memory 2x16GB G.Skill DDR5 7200Cas34
Video Card(s) Asus RTX4090 TUF
Storage Kingston KC3000 2TB NVME
Display(s) LG OLED CX48"
Case Corsair 5000D Air
Audio Device(s) KEF LSX II LT speakers + KEF KC62 Subwoofer
Power Supply Corsair HX850
Mouse Razor Viper Ultimate
Keyboard Corsair K75
Software win11
So you are one of those guys playing bar charts on tech sites and scrutinizing screenshots with a magnifying glass...
Guess what? That's not gaming.
The mile you're talking about doesn't matter a inch to the average gamer because outside of bar charts there is no visible difference for the average gamer in the real world. Mind you, I'm not advocating AMD, I'm just saying that outside of technological fanaticism those percentage differences really matter little.

Nah I'm the guy who play game everyday for the last 26 years, and bought lots of high-end GPUs during that period.

Sure I could have fun with whatever GPU i have got, but I would definitely have more fun with faster and more features packed GPU vs slower one.
 
Joined
Sep 1, 2020
Messages
2,068 (1.51/day)
Location
Bulgaria
Adding new features can come with a new architecture that's designed to deliver them, it can't just be by inflating frequency and power consumption.
 
Joined
Apr 14, 2022
Messages
671 (0.86/day)
Location
London, UK
Processor AMD Ryzen 7 5800X3D
Motherboard ASUS B550M-Plus WiFi II
Cooling Noctua U12A chromax.black
Memory Corsair Vengeance 32GB 3600Mhz
Video Card(s) Palit RTX 4080 GameRock OC
Storage Samsung 970 Evo Plus 1TB + 980 Pro 2TB
Display(s) Asus XG35VQ
Case Asus Prime AP201
Audio Device(s) Creative Gigaworks - Razer Blackshark V2 Pro
Power Supply Corsair SF750
Mouse Razer Viper
Software Windows 11 64bit
Even if the 3D V cache benefit the gpus, I don't think AMDs problem is the performance.
It varies from the gpu prices, lack of competitive features, drivers issues, no CUDA alternative etc.
 
Joined
Jan 8, 2017
Messages
9,108 (3.37/day)
System Name Good enough
Processor AMD Ryzen R9 7900 - Alphacool Eisblock XPX Aurora Edge
Motherboard ASRock B650 Pro RS
Cooling 2x 360mm NexXxoS ST30 X-Flow, 1x 360mm NexXxoS ST30, 1x 240mm NexXxoS ST30
Memory 32GB - FURY Beast RGB 5600 Mhz
Video Card(s) Sapphire RX 7900 XT - Alphacool Eisblock Aurora
Storage 1x Kingston KC3000 1TB 1x Kingston A2000 1TB, 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) LG UltraGear 32GN650-B + 4K Samsung TV
Case Phanteks NV7
Power Supply GPS-750C
ADA is still ahead by a mile...
Forget about FPS, FLOPS, GB/s, texture fill rate, etc fellas, a new metric just dropped : ahead by a mile.

What does it mean ? I don't know, but it's by a mile, I guess it depends how much of a fanboy you are.

It varies from the gpu prices
In case you forgot, AMD is still on top in terms of performance/price and Nvidia at the bottom, so this is complete nonsense.

1675076906680.png


lack of competitive features, drivers issues
Such as ?

no CUDA alternative
They have HIP and OpenCL, HIP is not supported on windows but I doubt this is relevant to the vast majority of users.
 
Last edited:
Joined
Dec 12, 2016
Messages
1,341 (0.49/day)
So you are one of those guys playing bar charts on tech sites and scrutinizing screenshots with a magnifying glass...
Guess what? That's not gaming.
The mile you're talking about doesn't matter a inch to the average gamer because outside of bar charts there is no visible difference for the average gamer in the real world. Mind you, I'm not advocating AMD, I'm just saying that outside of technological fanaticism those percentage differences really matter little.
Excellent post!

Nah I'm the guy who play game everyday for the last 26 years, and bought lots of high-end GPUs during that period.

Sure I could have fun with whatever GPU i have got, but I would definitely have more fun with faster and more features packed GPU vs slower one.
I’m curious what features enable you to have ‘more fun’? I’m honestly asking.
 
Joined
Sep 26, 2012
Messages
866 (0.20/day)
Location
Australia
System Name ATHENA
Processor AMD 7950X
Motherboard ASUS Crosshair X670E Extreme
Cooling ASUS ROG Ryujin III 360, 13 x Lian Li P28
Memory 2x32GB Trident Z RGB 6000Mhz CL30
Video Card(s) ASUS 4090 STRIX
Storage 3 x Kingston Fury 4TB, 4 x Samsung 870 QVO
Display(s) Acer X38S, Wacom Cintiq Pro 15
Case Lian Li O11 Dynamic EVO
Audio Device(s) Topping DX9, Fluid FPX7 Fader Pro, Beyerdynamic T1 G2, Beyerdynamic MMX300
Power Supply Seasonic PRIME TX-1600
Mouse Xtrfy MZ1 - Zy' Rail, Logitech MX Vertical, Logitech MX Master 3
Keyboard Logitech G915 TKL
VR HMD Oculus Quest 2
Software Windows 11 + Universal Blue
X3D was only good because Intel was being incompetent for 4 straight years
Nvidia however never sit back and relax

So overhyped & irrelevant that Nvidia going from Ampere to Lovelace went from 6MB of L2 Cache to 72MB. :\
 
Joined
Aug 21, 2013
Messages
1,723 (0.44/day)
They can already make a 7950XTX style easy without 3Dcache like they have do with the 6900 xt.

1) Switch GDDR6 20 Gbps to GDDR6X 24 Gbps chip

2) Put higher Power limite like 450W + 15% slider

3) take best binned silicone add 0.25V and a OC

That was the magical ~ bonus from a 6900 xt to 6950 xt and gain was correct for 100$ more ?
1. Never gonna happen. At this point G6X is something that only Nvidia uses. Besides with G6 getting faster (24-28Gbps on the pipeline) there is little reason to even use G6X as it's very inefficient in terms of power draw vs speed. So AMD can use G6 that is as fast as G6X.

2. It is not the power limit that is limiting performance. Reference cards need 3x8pin instead of 2x8pin and better official software undervolting to get better temps, lower pawer draw and higher clock speeds.

3. Neither AMD or Nvidia has any binned silicon at this point in terms of GPU's. Only some AIB's do binning (EVGA in the past and Galax now). But it's very resource intensive in terms of manpower.

4. I would also double the infinity cache because the option is there but not used on 7900XTX.

5. Does not add much but upgrade to PCIe 5.0 connector instead of PCIe 4.0 allowing to use fewer lanes on AM5 boards.
 
Joined
Dec 12, 2016
Messages
1,341 (0.49/day)
5. Does not add much but upgrade to PCIe 5.0 connector instead of PCIe 4.0 allowing to use fewer lanes on AM5 boards.
This is the most underreported benefit of going to later PCIe generations. PCIe is a serial interface. Unlike parallel, the number of lanes increases bandwidth linearly. If your device saturates at 4 GB/s you only need 1x PCIe 5.0 lane. This can allow an incredible cost savings as more lanes provide no additional benefit. An older PCIe generation would require more lanes and therefore more cost on the connector and motherboard traces.

Mainstream consumer motherboards could come way down in price if we can get rid of the obligatory x16 PCIe connectors. Just four lanes of PCIe 5.0 is enough for the latest GPUs. Less lanes also means less expensive chipsets or no chipset at all.
 
Top