Monday, March 21st 2022

AMD Announces 3rd Gen EPYC 7003 Processors with 3D Vertical Cache Technology, $4,000 to $8,000

AMD announced the general availability of the world's first data center CPU using 3D die stacking, the 3rd Gen AMD EPYC processors with AMD 3D V-Cache technology, formerly codenamed "Milan-X." Built on the "Zen 3" core architecture, these processors expand the 3rd Gen EPYC CPU family and can deliver up to 66 percent performance uplift across a variety of targeted technical computing workloads versus comparable, non-stacked 3rd Gen AMD EPYC processors.

These new processors feature the industry's largest L3 cache delivering the same socket, software compatibility and modern security features as 3rd Gen AMD EPYC CPUs while providing outstanding performance for technical computing workloads such as computational fluid dynamics (CFD), finite element analysis (FEA), electronic design automation (EDA) and structural analysis. These workloads are critical design tools for companies that must model the complexities of the physical world to create simulations that test and validate engineering designs for some of the world's most innovate products.
"Building upon our momentum in the data center as well as our history of industry-firsts, 3rd Gen AMD EPYC processors with AMD 3D V-Cache technology showcase our leadership design and packaging technology enabling us to offer the industry's first workload-tailored server processor with 3D die stacking technology," said Dan McNamara, senior vice president and general manager, Server Business Unit, AMD. "Our latest processors with AMD 3D V-Cache technology provide breakthrough performance for mission-critical technical computing workloads leading to better designed products and faster time to market."

"Customers' increased adoption of data-rich applications requires a new approach to data center infrastructure. Micron and AMD share a vision of delivering full capability of leading DDR5 memory to high-performance data center platforms," said Raj Hazra, senior vice president and general manager of the Compute and Networking Business Unit at Micron. "Our deep collaboration with AMD includes readying AMD platforms for Micron's latest DDR5 solutions as well as bringing 3rd Gen AMD EPYC processors with AMD 3D V-Cache technology into our own data centers, where we are already seeing up to a 40% performance improvement over 3rd Gen AMD EPYC processors without AMD 3D V-Cache on select EDA workloads."

Leading Packaging Innovations
Cache size increases have been at the forefront of performance improvement, particularly for technical computing workloads relying heavily on large data sets. These workloads benefit from increased cache size, however 2D chip designs have physical limitations on the amount of cache that can effectively be built on the CPU. AMD 3D V-Cache technology solves these physical challenges by bonding the AMD "Zen 3" core to the cache module, increasing the amount of L3 while minimizing latency and increasing throughput. This technology represents an innovative step forward in CPU design and packaging and enables breakthrough performance in targeted technical computing workloads.

Breakthrough Performance
The world's highest performance server processors for technical computing,4 the 3rd Gen AMD EPYC processors with AMD 3D V-Cache technology deliver faster time-to-results on targeted workloads, such as:
  • EDA - The 16-core, AMD EPYC 7373X CPU can deliver up to 66 percent faster simulations on Synopsys VCS, when compared to the EPYC 73F3 CPU.
  • FEA - The 64-core, AMD EPYC 7773X processor can deliver, on average, 44 percent more performance on Altair Radioss simulation applications compared to the competition's top of stack processor.
  • CFD - The 32-core AMD EPYC 7573X processor can solve an average of 88 percent more CFD problems per day than a comparable competitive 32-core count processor, while running Ansys CFX.
These performance capabilities ultimately enable customers to deploy fewer servers and reduce power consumption in the data center, helping to lower total cost of ownership (TCO), reduce carbon footprint and address their environmental sustainability goals. For instance, in a typical data center scenario running 4600 jobs per day of the Ansys CFX test case cfx-50, using 2P 32-core AMD EPYC 7573X CPU based servers can reduce the estimated number of servers required from 20 to 10 and lower power consumption by 49 percent, when compared to the competition's latest 2P 32-core processor-based server. This ends up providing a projected 51 percent lower TCO over three-years.
In other words, choosing 3rd Gen AMD EPYC processors with AMD 3D V-Cache technology in this deployment would have the environmental sustainability benefit of more than 81 acres of US forest per year in carbon sequestered equivalents.

The full AMD press deck follows:
Add your own comment

37 Comments on AMD Announces 3rd Gen EPYC 7003 Processors with 3D Vertical Cache Technology, $4,000 to $8,000

#1
Bomby569
So there's 4 CPU's for Epyc and only one for Ryzen. That makes no sense, unless money. AMD keeps backstabbing the people that supported them in the bad years.
Posted on Reply
#2
ncrs
I was genuinely surprised at the performance numbers posted at Phoronix. In some workloads it gets almost 100% better results. A single 7773X is also capable of outperforming a dual socket top Ice Lake Xeon, while costing $134 more then one of the Xeons. Competition is great!
Posted on Reply
#3
windwhirl
Bomby569So there's 4 CPU's for Epyc and only one for Ryzen. That makes no sense, unless money. AMD keeps backstabbing the people that supported them in the bad years.
What are you talking about?
Posted on Reply
#4
Rares
Bomby569So there's 4 CPU's for Epyc and only one for Ryzen. That makes no sense, unless money. AMD keeps backstabbing the people that supported them in the bad years.
You're high or something ? What are you talking about ?
Posted on Reply
#5
ncrs
RaresYou're high or something ? What are you talking about ?
I think he means that for Ryzen we're only going to get 5800X3D as an implementation of 3D V-cache, while EPYCs get 4 different models.

I've done some quit math and by the posted prices it looks like the 3D V-cache layer is adding on average around $100 per chiplet, so a theoretical 5900/5950X3D would cost $200 more.
Posted on Reply
#6
Daven
Bomby569So there's 4 CPU's for Epyc and only one for Ryzen. That makes no sense, unless money. AMD keeps backstabbing the people that supported them in the bad years.
Wut? That doesn’t make any sense.
Posted on Reply
#7
Unregistered
ncrsI think he means that for Ryzen we're only going to get 5800X3D as an implementation of 3D V-cache, while EPYCs get 4 different models.

I've done some quit math and by the posted prices it looks like the 3D V-cache layer is adding on average around $100 per chiplet, so a theoretical 5900/5950X3D would cost $200 more.
I think AMD just made a one off, maybe because it is difficult to make (e.g it doesn't overclock).
Plus like your said it would make R9s very expensive.
#8
Makaveli
Bomby569So there's 4 CPU's for Epyc and only one for Ryzen. That makes no sense, unless money. AMD keeps backstabbing the people that supported them in the bad years.
You have to remember AMD is a publicly traded company with shareholders. They make more money selling enterprise processors than desktop cpu's so that is a priority. Get out of your personal feelings this is just business!
Posted on Reply
#9
Punkenjoy
Xex360I think AMD just made a one off, maybe because it is difficult to make (e.g it doesn't overclock).
Plus like your said it would make R9s very expensive.
Exactly

They are still gathering experience on the process. Also, on desktop, most workload will not benefits from the additional cache and could be impacted by the lower clock. Gaming on the other side can benefits from it but i doubt a dual CCD would get way more performance than a 8 core with that.

The thing is it is as fast to do a ram access than accessing the other CCD L3 cache, so it wouldn't help for CCD to CCD communication. I suspect it would only be a tiny fraction faster in some rare game but for most game, unless it clock higher, it wouldn't make any difference. Some of the gain of the R9 series are due to the fact they also clock higher.

And it's expensive for lower sku. this is why it's mostly on Epyc CPU where the margin are super high and the added cost is probably marginal.

And i think it's fine. R7 5800X3D is a tech demo and a place holder while we wait for Zen 4 that will get out soon.
Posted on Reply
#10
Makaveli
PunkenjoyAnd i think it's fine. R7 5800X3D is a tech demo and a place holder while we wait for Zen 3 that will get out soon.
Zen 4
Posted on Reply
#11
SL2
Bomby569That makes no sense, unless money.
What do you think AMD is? A Magical Dolphin?
Posted on Reply
#12
defaultluser
its going to be a long slog waiting for 58003d, but it will be worth the wait.

I'm curious to see how much complex emulators like rps3 improve!
Posted on Reply
#13
DrCR
Bomby569So there's 4 CPU's for Epyc and only one for Ryzen. That makes no sense, unless money. AMD keeps backstabbing the people that supported them in the bad years.
If AMD decided for some reason to drop Ryzen entirely and purely focus on the enterprise sector, you do realize that would in no way be unethical, right?
Posted on Reply
#14
Bomby569
ncrsI think he means that for Ryzen we're only going to get 5800X3D as an implementation of 3D V-cache, while EPYCs get 4 different models.
damn i was wondering if nobody was using their brains today, you saved them all
Posted on Reply
#15
Tomorrow
ncrsI think he means that for Ryzen we're only going to get 5800X3D as an implementation of 3D V-cache, while EPYCs get 4 different models.

I've done some quit math and by the posted prices it looks like the 3D V-cache layer is adding on average around $100 per chiplet, so a theoretical 5900/5950X3D would cost $200 more.
Considering that 5950X started at 800 and is now selling under 600 then adding 200 would mean original MSRP. But clearly based on the fact that most consumer workloads (except games) dont benefit from massive L3 cache it made sense to make 5800X3D. Still considering they priced it the same as 5800X MSRP i would have like to have seen 5600X3D too at 5600X MSRP as a premium 6c/12t gaming option. But as an enthusiast seeing 5950X3D would have been cool tho im not sure it would have been much faster than 5800X3D. Tho they could have made it 5Ghz boost but it looks like we will have to wait for Zen4 to get 5Ghz+ models.
Posted on Reply
#16
ncrs
TomorrowConsidering that 5950X started at 800 and is now selling under 600 then adding 200 would mean original MSRP. But clearly based on the fact that most consumer workloads (except games) dont benefit from massive L3 cache it made sense to make 5800X3D. Still considering they priced it the same as 5800X MSRP i would have like to have seen 5600X3D too at 5600X MSRP as a premium 6c/12t gaming option. But as an enthusiast seeing 5950X3D would have been cool tho im not sure it would have been much faster than 5800X3D. Tho they could have made it 5Ghz boost but it looks like we will have to wait for Zen4 to get 5Ghz+ models.
5950X3D would've made a killer workstation/mini-server chip (since it can take up to 128GB ECC RAM). That would probably make it a threat for some Threadrippers tho :)
Posted on Reply
#17
SL2
Bomby569damn i was wondering if nobody was using their brains today, you saved them all
Nope, ntcs can't save you. AMD needs money to evolve. You can't go all out emotional like that on corporate business , nobody cares.
ncrsI think he means that for Ryzen we're only going to get 5800X3D as an implementation of 3D V-cache, while EPYCs get 4 different models.
Well it's easy to forget how much R&D money all those super expensive server chips make. Ryzen would most likely be nowhere as good as they are today without server sales.
AMD can survive without consumer chips, while the opposite is not very likely.
ncrsI've done some quit math and by the posted prices it looks like the 3D V-cache layer is adding on average around $100 per chiplet, so a theoretical 5900/5950X3D would cost $200 more.
Not worth it, and I don't mean in terms of end user price. First of all you have to look at the current 16 core sales to see that it's not a huge market, and then you have Zen4 six months from now, and you need the server chips to keep AMD going. Add maybe ten more factors that we don't know about and you're starting to have picture of which is the right thing to do.

Sell a 5950X3D for five months on a dying platform, and after that point the small number of sold units will start dropping,
or sell Milan-X that has no competition for quite a while and make much more money..
ncrs5950X3D would've made a killer workstation/mini-server chip (since it can take up to 128GB ECC RAM). That would probably make it a threat for some Threadrippers tho :)
Do we really know that? Do you know for sure that all that extra cache is that useful? For some types of engineering, yes, and for a few other things, but there are a lot of other types of work that relies more on GPU's, for instance.

Over and over I see all these comments from people drooling all over that beefy cache, yet none of us knows how useful it is yet. Just wait for reviews.

Also, AMD want's to sell Threadripper PRO's. :D
Posted on Reply
#18
Makaveli
MatsOver and over I see all these comments from people drooling all over that beefy cache, yet none of us knows how useful it is yet. Just wait for reviews.
1000% do no fall for marketing and hype. Always wait for 3rd party reviews before opening the wallet.
Posted on Reply
#19
ncrs
MatsWell it's easy to forget how much R&D money all those super expensive server chips make. Ryzen would most likely be nowhere as good as they are today without server sales.
AMD can survive without consumer chips, while the opposite is not very likely.
Yes, and let's not forget that Zen was originally designed as a server architecture. Ryzen is just a byproduct of EPYC really, or rather a part of a brilliant strategy used to avoid having to develop multiple versions of the same microarchitecture for different markets (like Intel has to). The economies of scale worked really well for the chiplet-based designs.
MatsNot worth it, and I don't mean in terms of end user price. First of all you have to look at the current 16 core sales to see that it's not a huge market, and then you have Zen4 six months from now, and you need the server chips to keep AMD going. Add maybe ten more factors that we don't know about and you're starting to have picture of which is the right thing to do.

Sell a 5950X3D for five months on a dying platform, and after that point the small number of sold units will start dropping,
or sell Milan-X that has no competition for quite a while and make much more money..
I agree, it was not worth the effort on AM4.
MatsDo we really know that? Do you know for sure that all that extra cache is that useful? For some types of engineering, yes, and for a few other things, but there are a lot of other types of work that relies more on GPU's, for instance.

Over and over I see all these comments from people drooling all over that beefy cache, yet none of us knows how useful it is yet. Just wait for reviews.
We can be fairly certain by extrapolating EPYC numbers, check out the Phoronix article I linked in my first reply. It covers a lot of different kinds of software and the gains are very formidable. 7773X is also running at lower base clocks just like 5800X3D will.
Posted on Reply
#20
Daven
Bomby569damn i was wondering if nobody was using their brains today, you saved them all
Your brain must be off because enterprise CPUs go into server banks that provide millions of services worldwide including the host for techpowerup and all the updates/data storage for all the games you play. Humanity needs cloud storage, HPC, servers, etc way way way more than anything you need as an individual for your home PC.
Posted on Reply
#21
SL2
Makaveli1000% do no fall for marketing and hype. Always wait for 3rd party reviews before opening the wallet.
Besides, AMD never even tried to sell X3D for non-gaming workloads so it's kind of difficult to stay optimistic on that point, there were no hype to begin with.

But, don't underestimate the power of hyping higher numbers!
ncrsWe can be fairly certain by extrapolating EPYC numbers, check out the Phoronix article I linked in my first reply. It covers a lot of different kinds of software and the gains are very formidable. 7773X is also running at lower base clocks just like 5800X3D will.
I meant, is there really a market for that kind of chip? Of all Ryzens sold, how many are 16 core? 1 %? 3 %? Out of those 16 cores sold, how many would be used for work in your link where the X3D would be substantially faster? That would most likely be less than 1 %.

So yeah, of course there are benefits to the extra cache, the question is for how many potential buyers? 1 % out of 3 % is maybe not worth a separate SKU, and all the required firmware work to make that chip supported in ALL those motherboards.

If you're studying FEM you don't have to make that kind of advanced analyzing, and if you work with it you'll most likely have better resources available than your desktop for that.
Posted on Reply
#22
Max(IT)
MatsOver and over I see all these comments from people drooling all over that beefy cache, yet none of us knows how useful it is yet. Just wait for reviews.
Well, I hope it will be useful for gaming, at least.
Otherwise the 5800X3D will be a total waste of silicon...
Posted on Reply
#23
Makaveli
DavenYour brain must be off because enterprise CPUs go into server banks that provide millions of services worldwide including the host for techpowerup and all the updates/data storage for all the games you play. Humanity needs cloud storage, HPC, servers, etc way way way more than anything you need as an individual for your home PC.
This is the problem with alot of enthusiast on tech forums tunnel vision the computing world is far bigger than Gaming and Personal computers. And Intel and AMD will happily show you where you are on the pecking order we do not sit above the enterprise market.
Posted on Reply
#24
ncrs
MatsI meant, is there really a market for that kind of chip? Of all Ryzens sold, how many are 16 core? 1 %? 3 %? Out of those 16 cores sold, how many would be used for work in your link where the X3D would be substantially faster? That would most likely be less than 1 %.

So yeah, of course there are benefits to the extra cache, the question is for how many potential buyers? 1 % out of 3 % is maybe not worth a separate SKU, and all the required firmware work to make that chip supported in ALL those motherboards.
A very specific market, yes. Worth the effort from AMD? Not really.

But there's always the PR aspects of having a halo product like the i7-8086K was, for example :)

As for the BIOS support I don't think it would be a big deal, they do have to make a new version for 5800X3D anyway.
Posted on Reply
#25
Bomby569
DavenYour brain must be off because enterprise CPUs go into server banks that provide millions of services worldwide including the host for techpowerup and all the updates/data storage for all the games you play. Humanity needs cloud storage, HPC, servers, etc way way way more than anything you need as an individual for your home PC.
Oh are we going to stop gaming or browsing the internet so as to not waste electricity and help humanity and the Planet?

We have a saint here. Please less hypocrisy
Posted on Reply
Add your own comment
Apr 16th, 2024 15:20 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts