Tuesday, January 27th 2015

GTX 970 Memory Drama: Plot Thickens, NVIDIA has to Revise Specs

It looks like NVIDIA's first response to the GeForce GTX 970 memory allocation controversy clearly came from engineers who were pulled out of their weekend plans, and hence was too ambiguously technical (even for us). It's only on Monday that NVIDIA PR swung into action, offering a more user-friendly explanation on what the GTX 970 issue is, and how exactly did they carve the GM204 up, when creating the card.

According to an Anandtech report, which cites that easy explanation from NVIDIA, the company was not truthful about specs of GTX 970, at launch. For example, the non-public document NVIDIA gave out to reviewers (which gives them detailed tech-specs), had clearly mentioned ROP count of the GTX 970 to be 64. Reviewers used that count in their reviews. TechPowerUp GPU-Z shows ROP count as reported by the driver, but it has no way of telling just how many of those "enabled" ROPs are "active." The media reviewing the card were hence led to believe that the GTX 970 was carved out by simply disabling three out of sixteen streaming multiprocessors (SMMs), the basic indivisible subunits of the GM204 chip, with no mention of other components like the ROP count, and L2 cache amount being changed from the GTX 980 (a full-fledged implementation of this silicon).
NVIDIA explained to Anandtech that there was a communication-gap between the engineers (the people who designed the GTX 970 ASIC), and the technical marketing team (the people who write the Reviewer's Guide document, and draw the block-diagram). This team was unaware that with "Maxwell," you could segment components previously thought indivisible, or that you could "partial disable" components.

It turns out that in addition to three SMX units being disabled (resulting in 1,664 CUDA cores), NVIDIA reduced the L2 cache (last-level cache) on this chip to 1.75 MB, down from 2 MB, and also disabled a few ROPs. The ROP count is effectively 56, and not 64. The last 8 ROPs aren't "disabled." They're active, but not used, because their connection to the crossbar is too slow (we'll get to that in a bit). The L2 cache is a key component of the "crossbar." Think of the crossbar as a town-square for the GPU, where the various components of the GPU talk to each other by leaving and picking-up data labeled with "from" and "to" addresses. The crossbar routes data between the four Graphics Processing Clusters (GPCs), and the eight memory controllers of 64-bit bus width each (which together make up its 256-bit wide memory interface), and is cushioned by the L2 cache.

The L2 cache itself is segmented, and isn't a monolithic slab of SRAM. Each of the eight memory controllers on the GM204 is ideally tied to its segment of the L2 cache. Also tied to these segments are segments of ROPs. With NVIDIA reducing the L2 cache amount by disabling one such segment. Its component memory controller is instead rerouted to the cache segment of a neighbouring memory controller. Access to the crossbar for that memory controller is hence slower. To make sure there are no issues caused to the interleaving of these memory controllers, adding up to the big memory amount figure that the driver can address, NVIDIA partitioned the 4 GB of memory to two segments. The first is 3.5 GB large, and is made up of memory controllers with access to their own segments of the L2; the second segment is 512 MB in size, and is tied to that memory controller which is rerouted.

The way this partitioning works, is that the 3.5 GB partition can't be read while the 512 MB one is being read. Only to an app that's actively using the entire 4 GB of memory, there will be a drop in performance, because the two segments aren't being read at the same time. The GPU is either addressing the 3.5 GB segment, or the 512 MB one. Hence, there's a drop in performance to be expected, again, for apps that use up the entire 4 GB of memory.

While it's technically correct that the GTX 970 has a 256-bit wide memory interface, and given its 7.00 GHz (GDDR5-effective) memory clock, that translates to 224 GB/s of bandwidth on paper, not all of that memory is uniformly fast. You have 3.5 GB of it having normal access to the crossbar (the town-square of the GPU), and 512 MB of it having slower access. Therefore, the 3.5 GB segment really just has 196 GB/s of memory bandwidth (7.00 GHz x 7 ways to reach the crossbar x 32-bit width per chip), which can be said with certainty. Nor can we say how this segment affects the performance of the memory controller whose crossbar port it's using, if the card is using its full 4 GB. We can't tell how fast the 512 MB second segment really is. But it's impossible for the second segment to make up 28 GB/s (of the 224 GB/s), since NVIDIA itself claims this segment is running slower. Therefore NVIDIA's claims of GTX 970 memory bandwidth being 224 GB/s at reference clocks is inaccurate.

Why NVIDIA chose to reduce cache size and ROP count will remain a mystery. We can't imagine that the people designing the chip will not have sufficiently communicated this to the driver and technical marketing teams. To claim that technical marketing didn't get this the first time around, seems like a hard-sell. We're pretty sure that NVIDIA engineers read reviews, and if they saw "64 ROPs" on a first-page table, they would have reported it up the food-chain at NVIDIA. An explanation about this hardware change should have taken up an entire page in the technical documents the first time around, and NVIDIA could have saved itself a lot of explanation, much of it through the press.
Source: Anandtech
Add your own comment

138 Comments on GTX 970 Memory Drama: Plot Thickens, NVIDIA has to Revise Specs

#101
ensabrenoir
.....you know a trade up offer at a discounted price would be an epic Win for everyone. Then sell the 970's as refurbished.
Posted on Reply
#102
HumanSmoke
RCoonThe most hilarious thing about all this is that most of the people who are successfully RMA'ing their 970s are then buying a 980 as a replacement from the same retailer. It's not like NVidia is even losing anything out of this, if anything retailers and AIB's are probably going to make more profit from 980 sales now.
The world we live in.
A very practical demonstration of the power of mindshare. People may (and do) have issues with the company - myself included, but the product and the brand tend to stay in the forefront of the consumers perception...something that Intel has also been built on.

Having said that, how many mirrors must AMD's hierarchy broken, and how many black cats crossed their paths? Every time the competition slips up - this, Intel's Cougar Point SATA bug, Nvidia's 40nm woes (and the list goes on), and AMD are never in a position to capitalize.
Posted on Reply
#103
MustSeeMelons
So, they messed up - really want to see how are they going to fix this. If they do nothing and I will be affected - I doubt my next card will be from Nvidia, I have no problem jumping ship. All left to do is grab some popcorn and watch this unravel.
Posted on Reply
#104
Parn
HumanSmokeA very practical demonstration of the power of mindshare. People may (and do) have issues with the company - myself included, but the product and the brand tend to stay in the forefront of the consumers perception...something that Intel has also been built on.

Having said that, how many mirrors must AMD's hierarchy broken, and how many black cats crossed their paths? Every time the competition slips up - this, Intel's Cougar Point SATA bug, Nvidia's 40nm woes (and the list goes on), and AMD are never in a position to capitalize.
The reason AMD cannot capitalize on their competitors' recent slip ups is they do not have any competitive products on the market. A couple of examples are 290/290X being slower & less efficient than 970/980, Bulldozer/Piledriver being less performant than Sandy/Ivy.

When AMD WAS competitive back in the days of P3 1.13GHz recall & horrendus 1st Gen P4 efficiency, their K7 and K8 based CPU did manage to capitalize on those.
Posted on Reply
#105
GhostRyder
RCoonThe most hilarious thing about all this is that most of the people who are successfully RMA'ing their 970s are then buying a 980 as a replacement from the same retailer. It's not like NVidia is even losing anything out of this, if anything retailers and AIB's are probably going to make more profit from 980 sales now.
The world we live in.
That is the funniest part, its really hard to imagine how some peoples logic works in that sense. But then again one thing happening like that is not a reason to stop buying the components from them all together unless they consistently do it.
ParnThe reason AMD cannot capitalize on their competitors' recent slip ups is they do not have any competitive products on the market. A couple of examples are 290/290X being slower & less efficient than 970/980, Bulldozer/Piledriver being less performant than Sandy/Ivy.

When AMD WAS competitive back in the days of P3 1.13GHz recall & horrendus 1st Gen P4 efficiency, their K7 and K8 based CPU did manage to capitalize on those.
The R9 290X is right near the performance of a 980 and an older model card released over a year ago so its no shocker its not as good but especially comparing the higher resolution results they are on par and its better than the 970 in performance numbers while costing about the same/less/slightly more depending on the variant. If both the 980 and 970 were completely blowing away the 290X then that would be a different story but they really are not as even the 780ti is not much weaker than a 980 and bests the 970.

Either way in the end, all this can only make things better for everyone as it just shows people will at least put there foot down (Well at least enough to make a difference). This will help NVidia in the future with their next products not make the same mistakes.
Posted on Reply
#106
Casecutter
sergionographyAnd last but not least I wanna see more benchmarks on amd cards measuring the effectiveness/efficiency of the memory width vs throughput of gcn and have a more lower level look at architecture in general because I can't help but think amd just goes extreme on certain aspects and slaps random hardware on their chips, idk if anyone noticed but gcn cards have insane variance in efficiency between different chips because the design has become "less modular?"
Not to bust you hump... but you made recall my 8th grade spinster grammar teacher going ballistic :fear:
sergionographyOr should I say too modular?
As it was said by btarunr in this article, "This team (PR) was unaware that with "Maxwell," you could segment components previously thought indivisible, or that you could "partial disable" components." Nvidia (and AMD) if going this route will need to make such "disablements" hopefully more seamless and unnoticeable with upcoming product releases, or best just tell us.
Posted on Reply
#107
inferKNOX
I'm really bummed about all this! Not excited about the prospect of stuttering at higher rezos... and I was just on my way to stepping up my monitor to a ULMB, higher rez monitor.:shadedshu:

The GTX970 is my first foray to the green team since my 8600GT and it crossed oceans to get from the store to me, so swaps/refunds ain't really an option for me.
Give us free Witcher 3 preorder keys (and some other decent options like Mortal Kombat X / Arkham Knight / Resident Evil for those that want others) and let's call it a day, nVIDIA.
Posted on Reply
#108
rruff
ParnWhen AMD WAS competitive back in the days of P3 1.13GHz recall & horrendus 1st Gen P4 efficiency, their K7 and K8 based CPU did manage to capitalize on those.
AMD isn't competitive because they stopped investing in R&D. 2014 R&D was 58% of 2008. Nvidia now outspends their whole operation, and Intel outspends them many times over. It seems to me that AMD decided to quit competing many years ago, but they are dragging on as long as possible with older architecture. Like when the GTX 960 came out, they bragged that their 3 year old GPUs were still "competitive"! Sure, your top of the line GPUs from 3 years ago that you've been rebadging and dropping the price on, are competitive in FPS/$ at the low-mid range now. Nvidia could do the same thing, just invest in the top range, and rebadge and downgrade everything else, but I'm glad they don't.

I didn't really pay any attention to computers until I needed a new machine and built one last year. I initially looked at only AMD, because they were good last time I checked (2008), and I like the underdog. You could have called me a fan-boy. But as I got into the details I changed my mind.
Posted on Reply
#109
rruff
RCoonThe most hilarious thing about all this is that most of the people who are successfully RMA'ing their 970s are then buying a 980 as a replacement from the same retailer. It's not like NVidia is even losing anything out of this, if anything retailers and AIB's are probably going to make more profit from 980 sales now.
Nvidia is basically selling a 970 and a 980 for the price of a 980 in that case, and possibly getting something for the old 970s. Will we see a flood of used/refurbs on the market soon? Or will Nvidia just destroy them rather than dilute the sales of new 970s? How will Nvidia compensates the EVGAs and Neweggs for refunds that *aren't* upgrades but just cash?

I think Nvidia is losing a chunk of money even in the most ideal scenario.
Posted on Reply
#110
rruff
XzibitThe consumer can't sue Nvidia directly unless its a made by Nvidia since they don't put the memory, which is at issue on the board.
The architecture is the same on all, isn't it? It's Nvidia's design, not something the AIB's control.
Posted on Reply
#111
RejZoR
rruffAMD isn't competitive because they stopped investing in R&D. 2014 R&D was 58% of 2008. Nvidia now outspends their whole operation, and Intel outspends them many times over. It seems to me that AMD decided to quit competing many years ago, but they are dragging on as long as possible with older architecture. Like when the GTX 960 came out, they bragged that their 3 year old GPUs were still "competitive"! Sure, your top of the line GPUs from 3 years ago that you've been rebadging and dropping the price on, are competitive in FPS/$ at the low-mid range now. Nvidia could do the same thing, just invest in the top range, and rebadge and downgrade everything else, but I'm glad they don't.

I didn't really pay any attention to computers until I needed a new machine and built one last year. I initially looked at only AMD, because they were good last time I checked (2008), and I like the underdog. You could have called me a fan-boy. But as I got into the details I changed my mind.
Making wasteful R&D spending doesn't necessarily result in superior end products.
Posted on Reply
#112
rruff
RejZoRMaking wasteful R&D spending doesn't necessarily result in superior end products.
Of course not, but what does drastically cutting R&D signal? That isn't a move any company would make that intended to be competitive long term. AMD's direct competition is now outspending them >10x. Even if AMD's engineers are more clever than Nvidia's and Intel's, this seriously effects their ability to deliver new products.

Oh... and AMD is currently losing money while Nvidia and Intel are not. How to fix that? Cut "wasteful" R&D even more?
Posted on Reply
#113
Xzibit
rruffThe architecture is the same on all, isn't it? It's Nvidia's design, not something the AIB's control.
Yes its the same. You can sue both and at least in the US different states have additional consumer laws in addition to Federal laws.

FTC - Truth In Advertising

Nvidia is based in California
California - Truth In Advertising

Lawyers will decide where the money can be squeezed out from the best.
Posted on Reply
#114
HumanSmoke
ParnThe reason AMD cannot capitalize on their competitors' recent slip ups is they do not have any competitive products on the market. A couple of examples are 290/290X being slower & less efficient than 970/980, Bulldozer/Piledriver being less performant than Sandy/Ivy.
When AMD WAS competitive back in the days of P3 1.13GHz recall & horrendus 1st Gen P4 efficiency, their K7 and K8 based CPU did manage to capitalize on those.
Really?
So what is the excuse when AMD launched the Evergreen series (HD 5000) in September 2009? Between the launching of the HD 5970 (fastest card during virtually its entire lifetime), 5870, 5850 (best bang for buck card of its era), 5770 (best mainstream card of its era), and 5750, and the arrival of Nvidia's Fermi architecture at the end of March 2010, Nvidia fielded nothing newer than an 18-month old GT200 and an almost 2.5 year old G92.....yet AMD's discrete graphics market share actually declined.
It also doesn't explain how AMD's market share is steadily declining while the company still generally being first to market with new graphics architectures (Evergreen launched before Fermi, Southern Islands launched before Kepler).
And K7 and K8? At the height of AMD's competitiveness, the company never accounted for more than 25.3% of the x86 processor market, which was achieved in Q1 2006.
Posted on Reply
#115
64K
ParnThe reason AMD cannot capitalize on their competitors' recent slip ups is they do not have any competitive products on the market. A couple of examples are 290/290X being slower & less efficient than 970/980
It's not fair to compare the newer Maxwell architecture to the older 290/290X. When AMD releases their R9 380 in a couple of months then we will see a GPU that's probably a good bit faster than the GTX 980.

imo the reason AMD struggles so much is they charged too little for their chips. This is evidenced in the Profit Margin for AMD and Nvidia and Intel.

NVIDIA Corporation
Key stats and ratios
Q4 (Oct '14) 2014
Net profit margin 14.12% 10.65%
Operating margin 17.41% 12.01%
EBITD margin - 18.51%
Return on average assets 10.04% 6.44%
Return on average equity 16.31% 9.48%
Employees 8,808 -
CDP Score - 87 B
www.google.com/finance?cid=662925

Advanced Micro Devices, Inc.
Key stats and ratios

Q3 (Sep '14) 2013
Net profit margin 1.19% -1.57%
Operating margin 4.41% 1.92%
EBITD margin - 6.10%
Return on average assets 1.59% -1.99%
Return on average equity 13.16% -15.34%
Employees 10,671 -
CDP Score - 67 C
www.google.com/finance?q=NASDAQ:AMD&ei=hEjJVMCCFOOWsge1goDYCw

Intel Corporation
Key stats and ratios
Q3 (Sep '14) 2013
Net profit margin 22.79% 18.25%
Operating margin 30.97% 23.09%
EBITD margin - 39.01%
Return on average assets 14.59% 10.89%
Return on average equity 23.07% 17.58%
Employees 105,600 -
CDP Score - 85 B
www.google.com/finance?q=NASDAQ:INTC&ei=yEnJVNn3FJOTsgfRnYHYCg




Posted on Reply
#116
Parn
HumanSmokeReally?
So what is the excuse when AMD launched the Evergreen series (HD 5000) in September 2009? Between the launching of the HD 5970 (fastest card during virtually its entire lifetime), 5870, 5850 (best bang for buck card of its era), 5770 (best mainstream card of its era), and 5750, and the arrival of Nvidia's Fermi architecture at the end of March 2010, Nvidia fielded nothing newer than an 18-month old GT200 and an almost 2.5 year old G92.....yet AMD's discrete graphics market share actually declined.
It also doesn't explain how AMD's market share is steadily declining while the company still generally being first to market with new graphics architectures (Evergreen launched before Fermi, Southern Islands launched before Kepler).
And K7 and K8? At the height of AMD's competitiveness, the company never accounted for more than 25.3% of the x86 processor market, which was achieved in Q1 2006.
Forgot the Fermi delay, my fault.

Well, regarding AMD's market share in x86, their historical 25.3% figure was achieved because of the major success of K7 and K8. Don't forget Q1 2006 was about 6 months before Intel managed to return to dominance with their Core 2 series of CPUs. During the period between P3 Coppermine and Conroe, most enthusiasts and IT literate gamers had Athlon XP, 64, 64 X2, FX or Opeteron in their PCs. And I almost forgot that NV also got a free ride with their nForce chipsets on AMD's success at the time.
Posted on Reply
#117
HumanSmoke
ParnForgot the Fermi delay, my fault.
It isn't an isolated case by any means.
ParnWell, regarding AMD's market share in x86, their historical 25.3% figure was achieved because of the major success of K7 and K8. Don't forget Q1 2006 was about 6 months before Intel managed to return to dominance with their Core 2 series of CPUs.
I'm well aware of the timeline. I referenced this and a fair bit more ina series I wrote a few months back.
The reason of AMD's market share mediocrity is actually fairly simple. The company was founded on a sales/marketing foundation, Intel and Nvidia (and ATI for that matter) were founded on engineering. When you have substantial saleable IP from the get-go and it arrives at market in good shape, the company has a decided advantage (AMD's early years are mostly about making licensed copies of Fairchild TTL chips, Intel ROM/EPROM/SRAM/processors, analog circuits) in mindshare - firstly from the engineers in the companies they deal with, and later the roll-on effect to end users with the establishment of the brand. Once the brand has been established, any rival has to not only deliver better product, but the incumbent market leader also has to fail. Aside from the occasional blip, these two things have never occurred simultaneously to give AMD any advantage. Without the brand and IP basis, the company is playing follow-the-leader, it can't charge as much for products, it's margins are lower (see 64K's post above as example), and with lower revenue it can't take the financial risks on expansion and R&D without a greater risk of compromising the integrity of the company - you then sit at the crux of a damned if you do, damned if you don't situation. Play it safe (Cyrix, Mostek, S3, Matrox, Chips & Technologies etc.) and undergo death by a thousand cuts, or buy IP as a shortcut but incurring debt - as AMD did with the purchases of ATI, NexGen, the DEC licenses etc.

It also doesn't help that AMD promote the "underdog" persona - plenty of people root for the underdog, but a much larger percentage of people want to allied with the dominant brand.
Posted on Reply
#118
rruff
HumanSmokeNvidia fielded nothing newer than an 18-month old GT200 and an almost 2.5 year old G92.....yet AMD's discrete graphics market share actually declined.
Your link shows that AMD gained market share that year, while Nvidia declined a lot. Intel was the big winner.

2006 was the year that Nvidia jumped way ahead of ATI/AMD, and they've held about a 60% vs 40% market share lead in discrete graphics since then. Recently though, Nvidia's share has jumped to 72%. 40% to 28% in half a year is a steep decline for AMD. You could say that is a temporary thing and AMD will come on strong after they introduce new cards this year... but that remains to be seen. I fully expect AMD's top card to beat the GTX 980 in performance, but it will be 28nm and likely no more power efficient than previous AMD offerings, which means it will be a beast. Lower down the pecking order I don't expect their new cards to be any more impressive than the R9 285.
Posted on Reply
#119
xfia
rruffYour link shows that AMD gained market share that year, while Nvidia declined a lot. Intel was the big winner.

2006 was the year that Nvidia jumped way ahead of ATI/AMD, and they've held about a 60% vs 40% market share lead in discrete graphics since then. Recently though, Nvidia's share has jumped to 72%. 40% to 28% in half a year is a steep decline for AMD. You could say that is a temporary thing and AMD will come on strong after they introduce new cards this year... but that remains to be seen. I fully expect AMD's top card to beat the GTX 980 in performance, but it will be 28mm and likely no more power efficient than previous AMD offerings, which means it will be a beast. Lower down the pecking order I don't expect their new cards to be any more impressive than the R9 285.
all the rumors seem to point at the new radeons having hbm and 20nm cores
Posted on Reply
#120
HumanSmoke
rruffYour link shows that AMD gained market share that year, while Nvidia declined a lot. Intel was the big winner.
Look past the graphs (and BTW, the reason Nvidia's overall graphics shipments slipped was because Intel basically killed Nvidia's IGP businesswith the release of the Nehalem architecture)
Broken down by form factor, AMD gained integrated mobile GPU market share but slipped in discrete in both desktop and mobile. NVIDIA's share of the discrete desktop market grew in the fourth quarter,
oranother similar take:
It seems the Radeon HD 5870, HD 5850, HD 5770, HD 5750 and even the almighty HD 5970 were just not enough – or simply just not in enough supply – to tempt punters away from the more widely available 55nm offerings from Nvidia, and that’s even with the temptations of EyeFinity and DX11. Perhaps people don’t care about flashy features as much as AMD thinks they should.
rruffNvidia's share has jumped to 72%. 40% to 28% in half a year is a steep decline for AMD. You could say that is a temporary thing and AMD will come on strong after they introduce new cards this year... but that remains to be seen.
AMD have released new graphics series before- and as I noted, some had little or no competition from Nvidia....yet the historical data and balance sheet doesn't lie

Posted on Reply
#121
newtekie1
Semi-Retired Folder
ensabrenoirThen sell the 970's as refurbished.
Yeah, so I can buy a second on the cheap!
Posted on Reply
#122
rruff
xfiaall the rumors seem to point at the new radeons having hbm and 20nm cores
This is where I got 28nm:

Posted on Reply
#123
xfia
14 to 28 is a huge jump in lithography.. guess we just need to wait for the real deal to hit the market.
Posted on Reply
#124
Prima.Vera
64K...When AMD releases their R9 380 in a couple of months then we will see a GPU that's probably a good bit faster than the GTX 980.
And then, nVidia will release in 1 week time the 980Ti. Same ol' same 'ol.
Posted on Reply
Add your own comment
Nov 21st, 2026 12:08 PST change timezone

New Forum Posts

Popular Reviews

TPU on YouTube

Controversial News Posts