• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD Expresses its Displeasure Over Intel's PT Benchmarks for 9th Gen Core

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
46,283 (7.69/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
AMD gave its first major reaction to the Principled Technologies (PT) controversy, in which it came out strongly against the questionable methods PT employed, in its performance comparison between the Core i9-9900K and AMD Ryzen 7 2700X, in addition to certain other Ryzen Threadripper series products. In its response, AMD made its official position on controversy clear - it is not happy with PT.

AMD prepared a long list of flaws with PT's original testing, and the areas where it did not correct the mistakes in its second testing. The company also put out a list of its own "best practices" for comparative benchmarking, which prescribes "sanitizing the operating system," "sanitizing the platform" for stock vs. overclocked testing, "sanitizing the data," and to not create a vast disconnect between the test environment and the real-world.



View at TechPowerUp Main Site
 
Joined
Mar 4, 2015
Messages
261 (0.08/day)
Their orginal methodologies were so flawed it really begs the question how they've surivived this long as a company. Such basic inept errors were made, it would surely call in to question all their previous work over the years. If I were a client of theirs I'd certainly be looking elsewhere. It's beyond farce.
 
Joined
Apr 12, 2013
Messages
6,729 (1.68/day)
Yeah no doubt about it, it's like the conclusions were preordained, sadly such practices are far too common & swept under the rug with the excuse that everyone does it :shadedshu:
 
Joined
Aug 2, 2011
Messages
1,448 (0.31/day)
Processor Ryzen 9 7950X3D
Motherboard MSI X670E MPG Carbon Wifi
Cooling Custom loop, 2x360mm radiator,Lian Li UNI, EK XRes140,EK Velocity2
Memory 2x16GB G.Skill DDR5-6400 @ 6400MHz C32
Video Card(s) EVGA RTX 3080 Ti FTW3 Ultra OC Scanner core +750 mem
Storage MP600 2TB,960 EVO 1TB,XPG SX8200 Pro 1TB,Micron 1100 2TB,OCZ Vector 512GB,1.5TB Caviar Green
Display(s) Acer X34S, Acer XB270HU
Case LianLi O11 Dynamic White
Audio Device(s) Logitech G-Pro X Wireless
Power Supply EVGA P3 1200W
Mouse Logitech G502 Lightspeed
Keyboard Logitech G512 Carbon w/ GX Brown
VR HMD HP Reverb G2 (V2)
Software Win 11

HTC

Joined
Apr 1, 2008
Messages
4,601 (0.79/day)
Location
Portugal
System Name HTC's System
Processor Ryzen 5 2600X
Motherboard Asrock Taichi X370
Cooling NH-C14, with the AM4 mounting kit
Memory G.Skill Kit 16GB DDR4 F4 - 3200 C16D - 16 GTZB
Video Card(s) Sapphire Nitro+ Radeon RX 480 OC 4 GB
Storage 1 Samsung NVMe 960 EVO 250 GB + 1 3.5" Seagate IronWolf Pro 6TB 7200RPM 256MB SATA III
Display(s) LG 27UD58
Case Fractal Design Define R6 USB-C
Audio Device(s) Onboard
Power Supply Corsair TX 850M 80+ Gold
Mouse Razer Deathadder Elite
Software Ubuntu 19.04 LTS
I'd like if AMD would, with whatever the next flagship CPU it launches would make 2 separate testings:

- the right way, as described in the 2nd pic of the OP
- the wrong way, as made in version one of PT's review but, in this occasion, favoring AMD instead of Intel, obviously

Would be interesting to see the comparison ...
 
Joined
Feb 16, 2017
Messages
475 (0.18/day)
I'd like if AMD would, with whatever the next flagship CPU it launches would make 2 separate testings:

- the right way, as described in the 2nd pic of the OP
- the wrong way, as made in version one of PT's review but, in this occasion, favoring AMD instead of Intel, obviously

Would be interesting to see the comparison ...
I'd like to think AMD's PR team is intelligent enough not to make themselves hypocrites.
 
Joined
Apr 19, 2011
Messages
2,198 (0.46/day)
Location
So. Cal.
Wow ... Spectre, cheating, and running hot like a new i9 9900K even though Intel gave them solder!
The show must go on...
 
Joined
Nov 5, 2014
Messages
714 (0.21/day)
"Enclosed thermal environment unsuitable for comparative testing" - What the systems had cases as opposed to open rigs? IMO that's a plus as it's mimics real world use..


Testing between AMD/Intel CPUs was so much easier when they used the same socket/platform lol, such a shame Intel had to block that >.>
 

eidairaman1

The Exiled Airman
Joined
Jul 2, 2007
Messages
40,435 (6.61/day)
Location
Republic of Texas (True Patriot)
System Name PCGOD
Processor AMD FX 8350@ 5.0GHz
Motherboard Asus TUF 990FX Sabertooth R2 2901 Bios
Cooling Scythe Ashura, 2Ă—BitFenix 230mm Spectre Pro LED (Blue,Green), 2x BitFenix 140mm Spectre Pro LED
Memory 16 GB Gskill Ripjaws X 2133 (2400 OC, 10-10-12-20-20, 1T, 1.65V)
Video Card(s) AMD Radeon 290 Sapphire Vapor-X
Storage Samsung 840 Pro 256GB, WD Velociraptor 1TB
Display(s) NEC Multisync LCD 1700V (Display Port Adapter)
Case AeroCool Xpredator Evil Blue Edition
Audio Device(s) Creative Labs Sound Blaster ZxR
Power Supply Seasonic 1250 XM2 Series (XP3)
Mouse Roccat Kone XTD
Keyboard Roccat Ryos MK Pro
Software Windows 7 Pro 64
Intel, of course bribing.

AMD should have people doing a slew of tests live with specs all posted on Youtube.
Obvious they can't trust PT for their unprofessional style.
 
Joined
Mar 16, 2017
Messages
1,637 (0.64/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
PT was used to give Intel an out. It’s not false advertising, as an independent company did the testing. Everyone will quickly forget the company “Principled Technologies,” just like they did with CTS-Lab, a company that still hasn’t published the documents on the AMD flaws it found, and it has done no other research since.
 

jsjones008

New Member
Joined
Aug 20, 2018
Messages
3 (0.00/day)
"Enclosed thermal environment unsuitable for comparative testing" - What the systems had cases as opposed to open rigs? IMO that's a plus as it's mimics real world use..


Testing between AMD/Intel CPUs was so much easier when they used the same socket/platform lol, such a shame Intel had to block that >.>
I think they're referring more to the specific case PT was using. The case they were using has very little direct airflow, and they were using the stock downdraft cooler on the AMD benches. This created a scenario where the CPU was not being properly cooled for the setup.
 

cdawall

where the hell are my stars
Joined
Jul 23, 2006
Messages
27,680 (4.29/day)
Location
Houston
System Name All the cores
Processor 2990WX
Motherboard Asrock X399M
Cooling CPU-XSPC RayStorm Neo, 2x240mm+360mm, D5PWM+140mL, GPU-2x360mm, 2xbyski, D4+D5+100mL
Memory 4x16GB G.Skill 3600
Video Card(s) (2) EVGA SC BLACK 1080Ti's
Storage 2x Samsung SM951 512GB, Samsung PM961 512GB
Display(s) Dell UP2414Q 3840X2160@60hz
Case Caselabs Mercury S5+pedestal
Audio Device(s) Fischer HA-02->Fischer FA-002W High edition/FA-003/Jubilate/FA-011 depending on my mood
Power Supply Seasonic Prime 1200w
Mouse Thermaltake Theron, Steam controller
Keyboard Keychron K8
Software W10P
I mean amd isn't exactly the king of fair in pr events on their own side, but this webpages delivery was a trashcan fire.
 

jsjones008

New Member
Joined
Aug 20, 2018
Messages
3 (0.00/day)
PT was used to give Intel an out. It’s not false advertising, as an independent company did the testing. Everyone will quickly forget the company “Principled Technologies,” just like they did with CTS-Lab, a company that still hasn’t published the documents on the AMD flaws it found, and it has done no other research since.
The thing with PT is like you said, they were hired by Intel.

My curiosity on the matter is if PT's original testing was carried out as Intel asked, purposefully giving them the numbers they wanted, and then the follow up was OK'd by Intel to try and stop the bleeding.

I know Steve from Gamer's Nexus interviewed one of the founders of PT, and according to him they tested it how they wanted and how they thought was appropriate, but if a big corporation is paying you big money for something, you're not going to throw said corporation under the bus.
 
  • Like
Reactions: hat
Joined
Mar 14, 2014
Messages
1,274 (0.35/day)
Processor i7-4790K 4.6GHz @1.29v
Motherboard ASUS Maximus Hero VII Z97
Cooling Noctua NH-U14S
Memory G. Skill Trident X 2x8GB 2133MHz
Video Card(s) Asus Tuf RTX 3060 V1 FHR (Newegg Shuffle)
Storage OS 120GB Kingston V300, Samsung 850 Pro 512GB , 3TB Hitachi HDD, 2x5TB Toshiba X300, 500GB M.2 @ x2
Display(s) Lenovo y27g 1080p 144Hz
Case Fractal Design Define R4
Audio Device(s) AKG Q701's w/ O2+ODAC (Sounds a little bright)
Power Supply EVGA Supernova G2 850w
Mouse Glorious Model D
Keyboard Rosewill Full Size. Red Switches. Blue Leds. RK-9100xBRE - Hate this. way to big
Software Win10
Benchmark Scores 3DMark FireStrike Score : needs updating
Still tho "Gaming Mode" .. seriously..you call it game mode then get pissed when they use it for games? Why even have it then?
 
Joined
Dec 7, 2011
Messages
18 (0.00/day)
Joined
Mar 10, 2015
Messages
3,984 (1.20/day)
System Name Wut?
Processor 3900X
Motherboard ASRock Taichi X570
Cooling Water
Memory 32GB GSkill CL16 3600mhz
Video Card(s) Vega 56
Storage 2 x AData XPG 8200 Pro 1TB
Display(s) 3440 x 1440
Case Thermaltake Tower 900
Power Supply Seasonic Prime Ultra Platinum
Still tho "Gaming Mode" .. seriously..you call it game mode then get pissed when they use it for games? Why even have it then?

Game Mode is for Threadripper. Why AMD gave it to Ryzen, who knows.
 

crazyeyesreaper

Not a Moderator
Staff member
Joined
Mar 25, 2009
Messages
9,753 (1.78/day)
Location
04578
System Name Old reliable
Processor Intel 8700K @ 4.8 GHz
Motherboard MSI Z370 Gaming Pro Carbon AC
Cooling Custom Water
Memory 32 GB Crucial Ballistix 3666 MHz
Video Card(s) MSI GTX 1080 Ti Gaming X
Storage 3x SSDs 2x HDDs
Display(s) Dell U2412M + Samsung TA350
Case Thermaltake Core P3 TG
Audio Device(s) Samson Meteor Mic / Generic 2.1 / KRK KNS 6400 headset
Power Supply Zalman EBT-1000
Mouse Mionix NAOS 7000
Keyboard Mionix
Still tho "Gaming Mode" .. seriously..you call it game mode then get pissed when they use it for games? Why even have it then?
ITs because the game mode is meant for legacy titles. Some games won't even run if more than 4 cores are present or have issues. Supreme Commander comes to mind.
 
Joined
Sep 17, 2014
Messages
20,782 (5.97/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
Well constructed response. I hope it gets enough exposure...
 

HTC

Joined
Apr 1, 2008
Messages
4,601 (0.79/day)
Location
Portugal
System Name HTC's System
Processor Ryzen 5 2600X
Motherboard Asrock Taichi X370
Cooling NH-C14, with the AM4 mounting kit
Memory G.Skill Kit 16GB DDR4 F4 - 3200 C16D - 16 GTZB
Video Card(s) Sapphire Nitro+ Radeon RX 480 OC 4 GB
Storage 1 Samsung NVMe 960 EVO 250 GB + 1 3.5" Seagate IronWolf Pro 6TB 7200RPM 256MB SATA III
Display(s) LG 27UD58
Case Fractal Design Define R6 USB-C
Audio Device(s) Onboard
Power Supply Corsair TX 850M 80+ Gold
Mouse Razer Deathadder Elite
Software Ubuntu 19.04 LTS
Joined
Dec 22, 2011
Messages
3,890 (0.87/day)
Processor AMD Ryzen 7 3700X
Motherboard MSI MAG B550 TOMAHAWK
Cooling AMD Wraith Prism
Memory Team Group Dark Pro 8Pack Edition 3600Mhz CL16
Video Card(s) NVIDIA GeForce RTX 3080 FE
Storage Kingston A2000 1TB + Seagate HDD workhorse
Display(s) Samsung 50" QN94A Neo QLED
Case Antec 1200
Power Supply Seasonic Focus GX-850
Mouse Razer Deathadder Chroma
Keyboard Logitech UltraX
Software Windows 11
Why get upset anyway? This duopoly can't fail whatever the other party does.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.96/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Why get upset anyway? This duopoly can't fail whatever the other party does.
So long as everyone is content to rely on x86 for running their applications, it's likely going to remain that way. It's not like there are really any good options, even if the software support is there (like with a lot of ARM variants.)
 
Joined
Jul 16, 2016
Messages
25 (0.01/day)
I think they're referring more to the specific case PT was using. The case they were using has very little direct airflow, and they were using the stock downdraft cooler on the AMD benches. This created a scenario where the CPU was not being properly cooled for the setup.

While Lyle trying to blow the dust off the running 2700x bench using a heat gun during benchmarking session.

They don't need PT for that: remember Polaris launch, where they claimed 2 cards surpassed the 1080 in AotS @ a much lower cost?

How did that turn out?

You mean Raja who said it... and you know how that turned out? Intel hired Raja with offer he can't refuse.
Says a lot about Intel eh.
Raja probably botched Vega because Intel told him to do that, and if he do it right Intel will cut him a fat check and give him a management position so Intel can take on much weaker GPU maker AMD before taking on Nvidia...
Everything makes sense now.
 
Last edited:
Joined
Sep 2, 2011
Messages
1,019 (0.22/day)
Location
Porto
System Name No name / Purple Haze
Processor Phenom II 1100T @ 3.8Ghz / Pentium 4 3.4 EE Gallatin @ 3.825Ghz
Motherboard MSI 970 Gaming/ Abit IC7-MAX3
Cooling CM Hyper 212X / Scythe Andy Samurai Master (CPU) - Modded Ati Silencer 5 rev. 2 (GPU)
Memory 8GB GEIL GB38GB2133C10ADC + 8GB G.Skill F3-14900CL9-4GBXL / 2x1GB Crucial Ballistix Tracer PC4000
Video Card(s) Asus R9 Fury X Strix (4096 SP's/1050 Mhz)/ PowerColor X850XT PE @ (600/1230) AGP + (HD3850 AGP)
Storage Samsung 250 GB / WD Caviar 160GB
Display(s) Benq XL2411T
Audio Device(s) motherboard / Creative Sound Blaster X-Fi XtremeGamer Fatal1ty Pro + Front panel
Power Supply Tagan BZ 900W / Corsair HX620w
Mouse Zowie AM
Keyboard Qpad MK-50
Software Windows 7 Pro 64Bit / Windows XP
Benchmark Scores 64CU Fury: http://www.3dmark.com/fs/11269229 / X850XT PE http://www.3dmark.com/3dm05/5532432
This speaks for itself:

Software and workloads used in performance tests may have been optimized for performance only on Intel® microprocessors. Performance tests, such as SYSmark* and MobileMark*, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit https://www.intel.com/benchmarks.

Intel is a sponsor and member of the BenchmarkXPRT Development Community, and was the major developer of the XPRT family of benchmarks. Principled Technologies is the publisher of the XPRT family of benchmarks.

Source:
https://www.intel.com/content/www/us/en/benchmarks/intel-product-performance.html
 
Last edited:

HTC

Joined
Apr 1, 2008
Messages
4,601 (0.79/day)
Location
Portugal
System Name HTC's System
Processor Ryzen 5 2600X
Motherboard Asrock Taichi X370
Cooling NH-C14, with the AM4 mounting kit
Memory G.Skill Kit 16GB DDR4 F4 - 3200 C16D - 16 GTZB
Video Card(s) Sapphire Nitro+ Radeon RX 480 OC 4 GB
Storage 1 Samsung NVMe 960 EVO 250 GB + 1 3.5" Seagate IronWolf Pro 6TB 7200RPM 256MB SATA III
Display(s) LG 27UD58
Case Fractal Design Define R6 USB-C
Audio Device(s) Onboard
Power Supply Corsair TX 850M 80+ Gold
Mouse Razer Deathadder Elite
Software Ubuntu 19.04 LTS
You mean Raja who said it... and you know how that turned out? Intel hired Raja with offer he can't refuse.
Says a lot about Intel eh.
Raja probably botched Vega because Intel told him to do that, and if he do it right Intel will cut him a fat check and give him a management position so Intel can take on much weaker GPU maker AMD before taking on Nvidia...
Everything makes sense now.

Apparently, Raja was deprived of 2 / 3 of the engineers assigned to work on Vega early during Vega's development, which were re-assigned to work with one of CPU projects (dunno which Zen version), or so i've read: can't seem to find where i read that, atm. This is the reason Vega took way way longer to be introduced VS the planned time and that may, quite possibly, have a direct impact in it's current performance.
 
Top