• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Why are reviewers so lazy? ( Not talking about TPU!!! )

Joined
Jan 24, 2008
Messages
888 (0.15/day)
System Name Meshify C Ryzen 2019
Processor AMD Ryzen 3900X
Motherboard X470 AORUS ULTRA GAMING
Cooling AMD Wraith Prism LED Cooler
Memory 32GB DDR4 ( F4-3200C16D-32GTZKW, 16-16-16-36 @ 3200Mhz )
Video Card(s) AMD Radeon RX6800 ( 2400Mhz/2150Mhz )
Storage Samsung Evo 960
Display(s) Pixio PX275h
Case Fractal Design Meshify C – Dark TG
Audio Device(s) Sennheiser GSP 300 ( Headset )
Power Supply Seasonic FOCUS Plus Series 650W
Mouse Logitech G502
Keyboard Logitech G 15
Software Windows 10 Pro 64bit
I have a problem with the fact that so many review website don't update their game collection and don't revisit older reviews one year later.
Here's a nice example:

What games does he use? Battlefield 1 ( while Battlefield V population is already 3 times bigger ), F1 2017 ( while F1 2018 population is 5 times bigger ) and an old Tombraider game. The numbers are there, the games tested or not getting played a much as the newer titles wich is normal offcourse. But another problem I see is that all the improvements AMD has done over the years, are not being displayed by using old benchmarks or by benchmarking older titles.

In BF1, at release the GTX 1080 wins from Vega 64. This is not the case in the latest version of BF1.
In BF V, the Vega 64 wins from the GTX 1080. But you still see reviewers referring to their older BF1 benchmarks and simply not using Battlefield V for benchmarking.

In F1 2017, at release, the GTX 1070 wins from Vega 64. This is no longer the case. Now the Vega 64 is even faster then the GTX 1080, just like in F1 2018.

And in the latest tombraider, the Vega 64 beats the GTX 1080 again, unlike the results from previous tombraider games at the release.

I hope at some point, Techpowerup can make the difference and starts revisiting older reviews one year later. Because in a years time, game patches and driver updates can make a big difference in the actual performance.
Also, when a new title gets released in a franchise and the new title has a bigger gamer population, they should simply stop benchmarking the older title or at least benchmark the older + the newer title.
And last but not least, if a title can be played in both DirectX 11 and 12, both should get tested. Because when Hardware unbox benchmarked Hitman only in DX11, it pissed me off because this is the reality:
Hitman DX11
GTX 1080 8% faster then Vega 64
Hitman DX12
The exact same performance

And this feedback is aimed at Techpowerup directly, stop benchmarking at the highest quality settings and start benchmarking at medium. The amount of gamers that play on Ultra only represents 10% at most. There are settings like shadow/lighting or post processing that almost every gamer turns down for the big performance impact or the disadvantage it gives in visibility. So why benchmark settings that 90% of gamers will not use.
 
Joined
Jan 29, 2012
Messages
6,447 (1.44/day)
Location
Florida
System Name natr0n-PC
Processor Ryzen 5950x/5600x
Motherboard B450 AORUS M
Cooling EK AIO 360 - 6 fan action
Memory Patriot - Viper Steel DDR4 (B-Die)(4x8GB)
Video Card(s) EVGA 3070ti FTW
Storage Various
Display(s) PIXIO IPS 240Hz 1080P
Case Thermaltake Level 20 VT
Audio Device(s) LOXJIE D10 + Kinter Amp + 6 Bookshelf Speakers Sony+JVC+Sony
Power Supply Super Flower Leadex III ARGB 80+ Gold 650W
Software XP/7/8.1/10
Benchmark Scores http://valid.x86.fr/79kuh6
There are some decent youtube channels that test games and settings just like you want.

Most reviewers test games at absurd settings because they have to or they get no more review samples.
 
Joined
Mar 26, 2010
Messages
9,805 (1.90/day)
Location
Jakarta, Indonesia
System Name micropage7
Processor Intel Xeon X3470
Motherboard Gigabyte Technology Co. Ltd. P55A-UD3R (Socket 1156)
Cooling Enermax ETS-T40F
Memory Samsung 8.00GB Dual-Channel DDR3
Video Card(s) NVIDIA Quadro FX 1800
Storage V-GEN03AS18EU120GB, Seagate 2 x 1TB and Seagate 4TB
Display(s) Samsung 21 inch LCD Wide Screen
Case Icute Super 18
Audio Device(s) Auzentech X-Fi Forte
Power Supply Silverstone 600 Watt
Mouse Logitech G502
Keyboard Sades Excalibur + Taihao keycaps
Software Win 7 64-bit
Benchmark Scores Classified
Actually it's fine with whatever criteria that they use as long as it's valid
And i don't agree test in medium setting why coz you can't see its power, if it is capable in high setting with high AA and AF it should be perform well in medium
 
Joined
Jan 24, 2008
Messages
888 (0.15/day)
System Name Meshify C Ryzen 2019
Processor AMD Ryzen 3900X
Motherboard X470 AORUS ULTRA GAMING
Cooling AMD Wraith Prism LED Cooler
Memory 32GB DDR4 ( F4-3200C16D-32GTZKW, 16-16-16-36 @ 3200Mhz )
Video Card(s) AMD Radeon RX6800 ( 2400Mhz/2150Mhz )
Storage Samsung Evo 960
Display(s) Pixio PX275h
Case Fractal Design Meshify C – Dark TG
Audio Device(s) Sennheiser GSP 300 ( Headset )
Power Supply Seasonic FOCUS Plus Series 650W
Mouse Logitech G502
Keyboard Logitech G 15
Software Windows 10 Pro 64bit
Joined
Mar 26, 2010
Messages
9,805 (1.90/day)
Location
Jakarta, Indonesia
System Name micropage7
Processor Intel Xeon X3470
Motherboard Gigabyte Technology Co. Ltd. P55A-UD3R (Socket 1156)
Cooling Enermax ETS-T40F
Memory Samsung 8.00GB Dual-Channel DDR3
Video Card(s) NVIDIA Quadro FX 1800
Storage V-GEN03AS18EU120GB, Seagate 2 x 1TB and Seagate 4TB
Display(s) Samsung 21 inch LCD Wide Screen
Case Icute Super 18
Audio Device(s) Auzentech X-Fi Forte
Power Supply Silverstone 600 Watt
Mouse Logitech G502
Keyboard Sades Excalibur + Taihao keycaps
Software Win 7 64-bit
Benchmark Scores Classified
If it is suck, why they have ultra setting in your pc?
Someone should sue nvidia/AMD coz they have ultra setting
 
Joined
Jan 24, 2008
Messages
888 (0.15/day)
System Name Meshify C Ryzen 2019
Processor AMD Ryzen 3900X
Motherboard X470 AORUS ULTRA GAMING
Cooling AMD Wraith Prism LED Cooler
Memory 32GB DDR4 ( F4-3200C16D-32GTZKW, 16-16-16-36 @ 3200Mhz )
Video Card(s) AMD Radeon RX6800 ( 2400Mhz/2150Mhz )
Storage Samsung Evo 960
Display(s) Pixio PX275h
Case Fractal Design Meshify C – Dark TG
Audio Device(s) Sennheiser GSP 300 ( Headset )
Power Supply Seasonic FOCUS Plus Series 650W
Mouse Logitech G502
Keyboard Logitech G 15
Software Windows 10 Pro 64bit
Actually it's fine with whatever criteria that they use as long as it's valid
And i don't agree test in medium setting why coz you can't see its power, if it is capable in high setting with high AA and AF it should be perform well in medium

Not true. Latest tombraider game on Ultra, 1080P, RX 580 is 13% faster then GTX 1060. GTX 1060 not even getting 60fps on Ultra.
Latest tombraider game on Medium, 1080p, RX 580 is 21% faster then GTX 1060, both cards getting more then 60fps.
So wich settings are RX 580 and GTX 1060 gamers are going to play on? And how many gamers actually own hardware faster than that?
And how many gamers are actually gaming with the fastest processer available like all those reviewers are using?
 
Last edited:
Joined
Aug 6, 2017
Messages
7,412 (3.00/day)
Location
Poland
System Name Purple rain
Processor 10.5 thousand 4.2G 1.1v
Motherboard Zee 490 Aorus Elite
Cooling Noctua D15S
Memory 16GB 4133 CL16-16-16-31 Viper Steel
Video Card(s) RTX 2070 Super Gaming X Trio
Storage SU900 128,8200Pro 1TB,850 Pro 512+256+256,860 Evo 500,XPG950 480, Skyhawk 2TB
Display(s) Acer XB241YU+Dell S2716DG
Case P600S Silent w. Alpenfohn wing boost 3 ARGBT+ fans
Audio Device(s) K612 Pro w. FiiO E10k DAC,W830BT wireless
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
why don't you just run your own channel "how to cherry pick settings to make radeons look better",unlike those lazy reviewers who don't even bother to find them and use stupid ultra presets :rolleyes:
 
Joined
Jan 24, 2008
Messages
888 (0.15/day)
System Name Meshify C Ryzen 2019
Processor AMD Ryzen 3900X
Motherboard X470 AORUS ULTRA GAMING
Cooling AMD Wraith Prism LED Cooler
Memory 32GB DDR4 ( F4-3200C16D-32GTZKW, 16-16-16-36 @ 3200Mhz )
Video Card(s) AMD Radeon RX6800 ( 2400Mhz/2150Mhz )
Storage Samsung Evo 960
Display(s) Pixio PX275h
Case Fractal Design Meshify C – Dark TG
Audio Device(s) Sennheiser GSP 300 ( Headset )
Power Supply Seasonic FOCUS Plus Series 650W
Mouse Logitech G502
Keyboard Logitech G 15
Software Windows 10 Pro 64bit
why don't you just run your own channel "how to cherry pick settings to make radeons look better",unlike those lazy reviewers who don't even bother to find them.

A reaction like yours doesnt suprise me from someone with a GTX 1080TI. Because I want honest reviews you call them "cherry pick settings" ?

If it is suck, why they have ultra setting in your pc?
Someone should sue nvidia/AMD coz they have ultra setting

Consoles are used for the baseline these days. Look at it as the medium settings. Then they reduce details for slower PC's ( = low settings ) and increase details and graphics for their trailers and all the marketing that comes with gameplay footage from reviewers and streamers ( high/ultra settigngs ) 10-15 years ago, consoles were not even close to pc's performance and graphics and were designed with highest settings in mind, not with medium settings like today. Isnt it Obvious that all PC games are just consoles ports these days?
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
27,065 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
I hope at some point, Techpowerup can make the difference and starts revisiting older reviews one year later
We don't recycle scores through test system revisions. Every time the test system is updated every single card is rebenched with the same hardware, driver, everything
 

Toothless

Tech, Games, and TPU!
Supporter
Joined
Mar 26, 2014
Messages
9,296 (2.51/day)
Location
Washington, USA
System Name Veral
Processor 5950x
Motherboard MSI MEG x570 Ace
Cooling Corsair H150i RGB Elite
Memory 4x16GB G.Skill TridentZ
Video Card(s) Powercolor 7900XTX Red Devil
Storage Crucial P5 Plus 1TB, Samsung 980 1TB, Teamgroup MP34 4TB
Display(s) Acer Nitro XZ342CK Pbmiiphx + 2x AOC 2425W
Case Fractal Design Meshify Lite 2
Audio Device(s) Blue Yeti + SteelSeries Arctis 5 / Samsung HW-T550
Power Supply Corsair HX850
Mouse Corsair Nightsword
Keyboard Corsair K55
VR HMD HP Reverb G2
Software Windows 11 Professional
Benchmark Scores PEBCAK
You should do reviews yourself. "If you want it done right do it yourself." (Or have it done how you want it)
 

silentbogo

Moderator
Staff member
Joined
Nov 20, 2013
Messages
5,476 (1.43/day)
Location
Kyiv, Ukraine
System Name WS#1337
Processor Ryzen 7 3800X
Motherboard ASUS X570-PLUS TUF Gaming
Cooling Xigmatek Scylla 240mm AIO
Memory 4x8GB Samsung DDR4 ECC UDIMM
Video Card(s) Inno3D RTX 3070 Ti iChill
Storage ADATA Legend 2TB + ADATA SX8200 Pro 1TB
Display(s) Samsung U24E590D (4K/UHD)
Case ghetto CM Cosmos RC-1000
Audio Device(s) ALC1220
Power Supply SeaSonic SSR-550FX (80+ GOLD)
Mouse Logitech G603
Keyboard Modecom Volcano Blade (Kailh choc LP)
VR HMD Google dreamview headset(aka fancy cardboard)
Software Windows 11, Ubuntu 20.04 LTS
I have a problem with the fact that so many review website don't update their game collection and don't revisit older reviews one year later.
The reason why no sane reviewer is gonna jump on benching the latest AAA titles, is because they are getting patched up and optimized on the go.
You may waste a lot of time juggling GPUs on a testbench and running benchmarks for a dozen cards, only to find out that 2 months later your results are irrelevant because [insert a developer name here] fixed a bug in post-processing implementation, which doubled everyone's FPS. BF V is a good example of that (at least for RTX).
If the game or a benchmark has been around for at least a year - then it's safe to say that it's already patched up to the point where you cannot expect any giant performance improvements.
There are some exceptions, though. For example, when new API comes out, or GPUs with new API/tech support hit the shelves, you usually have no choice but to test with some half-baked shit due to lack of alternatives: like Deus Ex: Mankind Divided && DX12, or BF:V and RTX, or Vulkan && highly experimental VK render in Talos Principle.

And this feedback is aimed at Techpowerup directly, stop benchmarking at the highest quality settings and start benchmarking at medium.
The reason benchmarks are done on highest available settings, is because it loads the GPU while minimizing the impact of CPU bottlenecking. Also, some games have a hard cap for max FPS, which makes matters even worse. You may get some wrong ideas if you see that on medium settings @1080p an RX470 and GTX1080Ti perform the same in Rocket League or whatever.
 

FordGT90Concept

"I go fast!1!11!1!"
Joined
Oct 13, 2008
Messages
26,259 (4.62/day)
Location
IA, USA
System Name BY-2021
Processor AMD Ryzen 7 5800X (65w eco profile)
Motherboard MSI B550 Gaming Plus
Cooling Scythe Mugen (rev 5)
Memory 2 x Kingston HyperX DDR4-3200 32 GiB
Video Card(s) AMD Radeon RX 7900 XT
Storage Samsung 980 Pro, Seagate Exos X20 TB 7200 RPM
Display(s) Nixeus NX-EDG274K (3840x2160@144 DP) + Samsung SyncMaster 906BW (1440x900@60 HDMI-DVI)
Case Coolermaster HAF 932 w/ USB 3.0 5.25" bay + USB 3.2 (A+C) 3.5" bay
Audio Device(s) Realtek ALC1150, Micca OriGen+
Power Supply Enermax Platimax 850w
Mouse Nixeus REVEL-X
Keyboard Tesoro Excalibur
Software Windows 10 Home 64-bit
Benchmark Scores Faster than the tortoise; slower than the hare.
You do have a point with benching brand new, just released games. NVIDIA almost always has an advantage there because they tend to have a "GameReady" driver out for it before it launches (which benchmarkers often use) where AMD tends to be a month or two behind. First benchmarks are, therefore, going to have an NVIDIA bias.

There's three reasons for NVIDIA being quicker:
1) Most developers develop on NVIDIA hardware (NVIDIA likes to hand out graphics cards to developers who ask, AMD not so much). Problems are discovered sooner and NVIDIA is notified earlier because the developers themselves see the problem and debug it.
2) Games that use GameWorks get NVIDIA involved much sooner in the development cycle than they would otherwise. This mostly applied to AAA games.
3) NVIDIA's drivers are more modular than AMD's drivers which allows NVIDIA to have a much faster release cadence than AMD but AMD's tend to be more polished because the whole package is QA tested.


I concur that benchmarks should be performed on Vulkan > D3D12 > D3D11 > OGL. D3D11 should never be used on a game that supports Vulkan and/or D3D12.
 
Last edited:
Joined
Jul 19, 2006
Messages
43,587 (6.70/day)
Processor AMD Ryzen 7 7800X3D
Motherboard ASUS TUF x670e
Cooling EK AIO 360. Phantek T30 fans.
Memory 32GB G.Skill 6000Mhz
Video Card(s) Asus RTX 4090
Storage WD m.2
Display(s) LG C2 Evo OLED 42"
Case Lian Li PC 011 Dynamic Evo
Audio Device(s) Topping E70 DAC, SMSL SP200 Headphone Amp.
Power Supply FSP Hydro Ti PRO 1000W
Mouse Razer Basilisk V3 Pro
Keyboard Tester84
Software Windows 11
why don't you just run your own channel "how to cherry pick settings to make radeons look better",unlike those lazy reviewers who don't even bother to find them and use stupid ultra presets :rolleyes:
Looks like they're trying and advertising it through their signature. I'm sure this is all about bringing themselves attention. Pathetic.
 
Joined
Jan 8, 2017
Messages
8,994 (3.36/day)
System Name Good enough
Processor AMD Ryzen R9 7900 - Alphacool Eisblock XPX Aurora Edge
Motherboard ASRock B650 Pro RS
Cooling 2x 360mm NexXxoS ST30 X-Flow, 1x 360mm NexXxoS ST30, 1x 240mm NexXxoS ST30
Memory 32GB - FURY Beast RGB 5600 Mhz
Video Card(s) Sapphire RX 7900 XT - Alphacool Eisblock Aurora
Storage 1x Kingston KC3000 1TB 1x Kingston A2000 1TB, 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) LG UltraGear 32GN650-B + 4K Samsung TV
Case Phanteks NV7
Power Supply GPS-750C
I agree that some game choices are downright bizarre and questionable.
 

rtwjunkie

PC Gaming Enthusiast
Supporter
Joined
Jul 25, 2008
Messages
13,909 (2.41/day)
Location
Louisiana -Laissez les bons temps rouler!
System Name Bayou Phantom
Processor Core i7-8700k 4.4Ghz @ 1.18v
Motherboard ASRock Z390 Phantom Gaming 6
Cooling All air: 2x140mm Fractal exhaust; 3x 140mm Cougar Intake; Enermax T40F Black CPU cooler
Memory 2x 16GB Mushkin Redline DDR-4 3200
Video Card(s) EVGA RTX 2080 Ti Xc
Storage 1x 500 MX500 SSD; 2x 6TB WD Black; 1x 4TB WD Black; 1x400GB VelRptr; 1x 4TB WD Blue storage (eSATA)
Display(s) HP 27q 27" IPS @ 2560 x 1440
Case Fractal Design Define R4 Black w/Titanium front -windowed
Audio Device(s) Soundblaster Z
Power Supply Seasonic X-850
Mouse Coolermaster Sentinel III (large palm grip!)
Keyboard Logitech G610 Orion mechanical (Cherry Brown switches)
Software Windows 10 Pro 64-bit (Start10 & Fences 3.0 installed)
We don't recycle scores through test system revisions. Every time the test system is updated every single card is rebenched with the same hardware, driver, everything
Don’t worry W1z, he’s just someone that hasn’t bothered to read the volumes already written in these forums by you and others with your review methodology.
 
Joined
May 8, 2016
Messages
1,741 (0.60/day)
System Name BOX
Processor Core i7 6950X @ 4,26GHz (1,28V)
Motherboard X99 SOC Champion (BIOS F23c + bifurcation mod)
Cooling Thermalright Venomous-X + 2x Delta 38mm PWM (Push-Pull)
Memory Patriot Viper Steel 4000MHz CL16 4x8GB (@3240MHz CL12.12.12.24 CR2T @ 1,48V)
Video Card(s) Titan V (~1650MHz @ 0.77V, HBM2 1GHz, Forced P2 state [OFF])
Storage WD SN850X 2TB + Samsung EVO 2TB (SATA) + Seagate Exos X20 20TB (4Kn mode)
Display(s) LG 27GP950-B
Case Fractal Design Meshify 2 XL
Audio Device(s) Motu M4 (audio interface) + ATH-A900Z + Behringer C-1
Power Supply Seasonic X-760 (760W)
Mouse Logitech RX-250
Keyboard HP KB-9970
Software Windows 10 Pro x64
Some games use BS antipirate software that simply bans a user for 24h after too many hardware changes.
In those games, you simply cannot do these types of benchmarking (20 cards+) in reasonable ammount of time (ie. till next game patch/driver version).
 
Last edited:
Joined
Jan 24, 2008
Messages
888 (0.15/day)
System Name Meshify C Ryzen 2019
Processor AMD Ryzen 3900X
Motherboard X470 AORUS ULTRA GAMING
Cooling AMD Wraith Prism LED Cooler
Memory 32GB DDR4 ( F4-3200C16D-32GTZKW, 16-16-16-36 @ 3200Mhz )
Video Card(s) AMD Radeon RX6800 ( 2400Mhz/2150Mhz )
Storage Samsung Evo 960
Display(s) Pixio PX275h
Case Fractal Design Meshify C – Dark TG
Audio Device(s) Sennheiser GSP 300 ( Headset )
Power Supply Seasonic FOCUS Plus Series 650W
Mouse Logitech G502
Keyboard Logitech G 15
Software Windows 10 Pro 64bit
We don't recycle scores through test system revisions. Every time the test system is updated every single card is rebenched with the same hardware, driver, everything

And you don't see that as a problem? For the AMD cards you are using the driver 18.8.2 in all the latest reviews in the last couple of months. And for the Battlefield V performance review, you had to use a driver that got released before 18.11.1 got released. Now have a look at the latest drivers release logs:

Up to 3% faster performance in F1 2018 using Radeon™ Software Adrenalin Edition 18.9.2 on the Radeon™ RX Vega 64 (8GB) graphics card than with Radeon™ Software Adrenalin Edition 18.8.2 at 2560x1440 (1440p).RS-249
Up to 4% faster performance in Shadow of the Tomb Raider using Radeon™ Software Adrenalin Edition 18.9.2 on the Radeon™ RX Vega 64 (8GB) graphics card than with Radeon™ Software Adrenalin Edition 18.8.2 at 2560x1440 (1440p).RS-251
Up to 8% faster performance in Battlefield V with Radeon™ Software Adrenalin Edition 18.11.1 on the Radeon™ RX Vega 64 (8GB) graphics card than with Radeon™ Software Adrenalin Edition 18.10.2 at 1920x1080. RS-231
Up to 9% faster performance in Battlefield V with Radeon™ Software Adrenalin Edition 18.11.1 on the Radeon™ RX 580 (8GB) graphics card than with Radeon™ Software Adrenalin Edition 18.10.2 at 1920x1080. RS-232
Up to 8% faster performance in Battlefield V with Radeon™ Software Adrenalin Edition 18.11.1 on the Radeon™ RX Vega 64 (8GB) graphics card than with Radeon™ Software Adrenalin Edition 18.10.2 at 1920x1080. RS-231
Up to 9% faster performance in Battlefield V with Radeon™ Software Adrenalin Edition 18.11.1 on the Radeon™ RX 580 (8GB) graphics card than with Radeon™ Software Adrenalin Edition 18.10.2 at 1920x1080. RS-232
Up to 5% faster performance in Wolfenstein II: The New Colossus using Radeon Software Adrenalin 2019 Edition 18.12.2 on the Radeon RX Vega 64 graphics card than with Radeon Software Adrenalin Edition 18.12.1 at 3840x2160 (4K). RS-280

These are only the performance improvements clearly mentioned by AMD. Their could be more. You can only know by benchmarking every card with the latest driver and every game with the latest patch every time a new peace of hardware gets released. That's the only way to do a fair comparison. You also review new Nvidia cards with newer drivers and old Nvidia cards with older drivers and put them in the same performance chart? Is that a fair comparison? You really think Nvidia gamers don't update their drivers when new games get released?

So basicly all your AMD benchmarks in the last couple of months are not valid and the Battlefield V performance review was already outdated one week after it got published. I know there is no money to be made by revisiting an older review. But honestly wich game is actually finished at release? Performance reviews should be done 3-6 months after the release, when the patches are done and the drivers are optimized. All performance reviews in the first months are just clickbate and provide no clear view of expexted gaming performance.
 
Joined
Sep 17, 2014
Messages
20,986 (5.96/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
I have a problem with the fact that so many review website don't update their game collection and don't revisit older reviews one year later.
Here's a nice example:

What games does he use? Battlefield 1 ( while Battlefield V population is already 3 times bigger ), F1 2017 ( while F1 2018 population is 5 times bigger ) and an old Tombraider game. The numbers are there, the games tested or not getting played a much as the newer titles wich is normal offcourse. But another problem I see is that all the improvements AMD has done over the years, are not being displayed by using old benchmarks or by benchmarking older titles.

In BF1, at release the GTX 1080 wins from Vega 64. This is not the case in the latest version of BF1.
In BF V, the Vega 64 wins from the GTX 1080. But you still see reviewers referring to their older BF1 benchmarks and simply not using Battlefield V for benchmarking.

In F1 2017, at release, the GTX 1070 wins from Vega 64. This is no longer the case. Now the Vega 64 is even faster then the GTX 1080, just like in F1 2018.

And in the latest tombraider, the Vega 64 beats the GTX 1080 again, unlike the results from previous tombraider games at the release.

I hope at some point, Techpowerup can make the difference and starts revisiting older reviews one year later. Because in a years time, game patches and driver updates can make a big difference in the actual performance.
Also, when a new title gets released in a franchise and the new title has a bigger gamer population, they should simply stop benchmarking the older title or at least benchmark the older + the newer title.
And last but not least, if a title can be played in both DirectX 11 and 12, both should get tested. Because when Hardware unbox benchmarked Hitman only in DX11, it pissed me off because this is the reality:
Hitman DX11
GTX 1080 8% faster then Vega 64
Hitman DX12
The exact same performance

And this feedback is aimed at Techpowerup directly, stop benchmarking at the highest quality settings and start benchmarking at medium. The amount of gamers that play on Ultra only represents 10% at most. There are settings like shadow/lighting or post processing that almost every gamer turns down for the big performance impact or the disadvantage it gives in visibility. So why benchmark settings that 90% of gamers will not use.

Here you go. Five seconds on Google...

https://www.tomshardware.com/reviews/amd-nvidia-driver-updates-performance-tested,5707.html
https://www.phoronix.com/scan.php?page=article&item=nvidia-16gpu-jan2018&num=2
https://www.computerbase.de/2017-01/geforce-treiber-test/2/

And, as for TPU? Members do the work.
@Artas1984
https://www.techpowerup.com/forums/...-353-62-vs-376-33-vs-398-36-vs-411-70.248256/


Bottom line, stop whining, start improving your interwebs skills. I guess you're just another example of Youtubers being blundering fools? Its a real pattern.

PS. if you want to attract subs and viewers, this is how NOT to do it. You just invalidated everything you produce on your channel for the entire TPU community.
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
27,065 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
You can only know by benchmarking every card with the latest driver and every game with the latest patch every time a new peace of hardware gets released. That's the only way to do a fair comparison.
That's simply not humanly possible, unless you hire several people benching for you all the time on multiple identical rigs (which introduces a lot of variation).

You forgot that everything should be tested on: Intel + Intel HEDT + Ryzen + Threadripper.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.93/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Michael at Phoronix is pretty good about doing benchmarks and looking at the differences between driver versions, but that's something completely different than doing a review of new cards. It's also a review for the Linux ecosystem which doesn't always translate into expected changes in Windows.

To be honest, I wouldn't mind seeing some driver benchmarks between older and newer versions. It doesn't have to happen all the time, but it could be enlightening much as the PCIe scaling reviews are.
That's simply not humanly possible, unless you hire several people benching for you all the time on multiple identical rigs (which introduces a lot of variation).

You forgot that everything should be tested on: Intel + Intel HEDT + Ryzen + Threadripper.
How about at the frequency at which do you PCIe scaling reviews and if you focus on just the drivers like how you focus on just PCIe?

Edit: Mind you, I'm just throwing ideas out there. I don't completely agree with the OP, but the observation is valid, just not the approach.
 
Joined
Sep 17, 2014
Messages
20,986 (5.96/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
Michael at Phoronix is pretty good about doing benchmarks and looking at the differences between driver versions, but that's something completely different than doing a review of new cards. It's also a review for the Linux ecosystem which doesn't always translate into expected changes in Windows.

To be honest, I wouldn't mind seeing some driver benchmarks between older and newer versions. It doesn't have to happen all the time, but it could be enlightening much as the PCIe scaling reviews are.

How about at the frequency at which do you PCIe scaling reviews and if you focus on just the drivers like how you focus on just PCIe?

Those things dó happen. There is a large table with bench results comparing Kepler and GCN across several drivers too, but I cba to look it up. This story is as old as graphics card benchmarks... and the overall tendency is that drivers show minimal performance gains over time in both camps, but it never really changes the hierarchy of a product stack - and as a buyer that is really the take away.

The TPU link however is a good example and the Phoronix link also has medium settings, which was mostly my point with that one. HWinfo I believe also tests medium on several resolutions... its nothing special really. There are also regular articles on big AMD driver releases where games are revisited across the web. Its not like OP has somehow found something substantial here, he just failed to look around.

The OP seems to focus mostly on Vega 64 switching spots with a 1080 but even that has been the case since launch, just depends on the game and resolution... and Vega hasn't become radically faster either, it gained a few percent across the board, but again, it doesn't change its place in GPU hierarchy, and it also doesn't make unplayable games (or even settings) playable.
 
Joined
Jan 24, 2008
Messages
888 (0.15/day)
System Name Meshify C Ryzen 2019
Processor AMD Ryzen 3900X
Motherboard X470 AORUS ULTRA GAMING
Cooling AMD Wraith Prism LED Cooler
Memory 32GB DDR4 ( F4-3200C16D-32GTZKW, 16-16-16-36 @ 3200Mhz )
Video Card(s) AMD Radeon RX6800 ( 2400Mhz/2150Mhz )
Storage Samsung Evo 960
Display(s) Pixio PX275h
Case Fractal Design Meshify C – Dark TG
Audio Device(s) Sennheiser GSP 300 ( Headset )
Power Supply Seasonic FOCUS Plus Series 650W
Mouse Logitech G502
Keyboard Logitech G 15
Software Windows 10 Pro 64bit
That's simply not humanly possible, unless you hire several people benching for you all the time on multiple identical rigs (which introduces a lot of variation).

You forgot that everything should be tested on: Intel + Intel HEDT + Ryzen + Threadripper.

You are correct. By doing that it would cost 5-10x more hours BUT the end result will end up with correct comparison charts.
What good is the latest KFA2 GeForce GTX 1060 6 GB GDDR5X Review review when the AMD results don't include the performance improvements form the last 4 months in F1 2018 and Wolfenstein 2 and possibly in other games, when you are using 3 different Nvidia drivers ( one for RTX 2070, one for RTX 2080 and 2080TI and one for all slower cards ) and when half of the games are already replaced by new titles in the same franchise and have a higher playercount ( somethimes 5-10 times greater ). And I know this looks like I'm attacking your businnes but I'm just stating facts here. It's not because all reviewers do it and because it has become the standard today, that I have to like the way hardware reviews are being done.
 
Last edited:

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.93/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Its not like OP has somehow found something substantial here, he just failed to look around.
...but if you have these kinds of reviews here and you don't have to search around, that's more traffic for TPU which isn't a bad thing though. I'm not saying the OP's suggestion is sound, I'm just saying that there are a lot more things to capture than just reviewing new cards and W1zz occasionally does that with things like the PCIe scaling reviews.
 
Joined
Sep 17, 2014
Messages
20,986 (5.96/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
...but if you have these kinds of reviews here and you don't have to search around, that's more traffic for TPU which isn't a bad thing though. I'm not saying the OP's suggestion is sound, I'm just saying that there are a lot more things to capture than just reviewing new cards and W1zz occasionally does that with things like the PCIe scaling reviews.

But... effectively these games ARE revisited with every GPU review, all you need to do is grab an old review and put it side by side. It does require you to read up on the test setups.

As for AMDs long period of time between releases, that is entirely their choice, and I think we also forget that this means you're stuck for 4 months with lacking performance - if you care so much about it, that seems as much a problem to me as not having the numbers?

You are correct. By doing that it would cost 5-10x more hours BUT the end result will end up with correct comparison charts.
What good is the latest KFA2 GeForce GTX 1060 6 GB GDDR5X Review review when the AMD results don't include the performance improvements form the last 4 months in F1 2018 and Wolfenstein 2 and possibly in other games, when you are using 3 different Nvidia drivers ( one for RTX 2070, one for RTX 2080 and 2080TI and one for all slower cards ) and when half of the games are already replaced by new titles in the same franchise and have a higher playercount ( somethimes 5-10 times greater ).

The reason to stick to a benchmark suite for a while is exactly because you can then compare cards across longer periods of time. You're completely missing the point here. A good selection of games depends not on player counts, it depends on what engines are being used, and how those engines push a GPU. We know that different architectures are more suited to specific engines, as much as they benefit from per-game optimizations. There are a lot more variables than the stale 'I want to know how game X plays on my GPU'. Reviews are an indicator, not an all encompassing truth. Even if you benchmark 1000 games, you can never capture the worst case scenarios in each game, so you still don't really know how the actual ingame perf will be. Also, people have radically different PC configurations, which again eliminates that idea.
 
Last edited:

rtwjunkie

PC Gaming Enthusiast
Supporter
Joined
Jul 25, 2008
Messages
13,909 (2.41/day)
Location
Louisiana -Laissez les bons temps rouler!
System Name Bayou Phantom
Processor Core i7-8700k 4.4Ghz @ 1.18v
Motherboard ASRock Z390 Phantom Gaming 6
Cooling All air: 2x140mm Fractal exhaust; 3x 140mm Cougar Intake; Enermax T40F Black CPU cooler
Memory 2x 16GB Mushkin Redline DDR-4 3200
Video Card(s) EVGA RTX 2080 Ti Xc
Storage 1x 500 MX500 SSD; 2x 6TB WD Black; 1x 4TB WD Black; 1x400GB VelRptr; 1x 4TB WD Blue storage (eSATA)
Display(s) HP 27q 27" IPS @ 2560 x 1440
Case Fractal Design Define R4 Black w/Titanium front -windowed
Audio Device(s) Soundblaster Z
Power Supply Seasonic X-850
Mouse Coolermaster Sentinel III (large palm grip!)
Keyboard Logitech G610 Orion mechanical (Cherry Brown switches)
Software Windows 10 Pro 64-bit (Start10 & Fences 3.0 installed)
You are correct. By doing that it would cost 5-10x more hours BUT the end result will end up with correct comparison charts.
5-10 hours per card. Normally multiple cards are released in the same time frame. For TPU reviews, every single comparison card is also REtested, results are never taken from a chart somewhere.

I’m just not sure you realize that the service you demand for free is handled by one man, who is darned well entitled to also have a life.
 
Top