• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Why are we not seeing Video Card reviews using other games?

EastCoasthandle

New Member
Joined
Apr 21, 2005
Messages
6,885 (1.00/day)
System Name MY PC
Processor E8400 @ 3.80Ghz > Q9650 3.60Ghz
Motherboard Maximus Formula
Cooling D5, 7/16" ID Tubing, Maze4 with Fuzion CPU WB
Memory XMS 8500C5D @ 1066MHz
Video Card(s) HD 2900 XT 858/900 to 4870 to 5870 (Keep Vreg area clean)
Storage 2
Display(s) 24"
Case P180
Audio Device(s) X-fi Plantinum
Power Supply Silencer 750
Software XP Pro SP3 to Windows 7
Benchmark Scores This varies from one driver to another.
For example a few from the following:
-Dirt
-Graw2
-The Chronicles Of Riddick <-awesome
-Lost Planet
-Call of Juarez
-Test Drive

Others include:
-Tiger Woods PGA Tour 07
-FIFA Soccer 07
-NBA Live 08
-Flight Simulator X Deluxe
-Close Combat: First to Fight

Just to name a few. I am not saying that all of these be used. What I am saying is that everyone doesn't/no longer plays Fear, BF2142, Quake 4, etc. A little diversity would be nice.
 
Last edited:

HellasVagabond

New Member
Joined
Jan 19, 2007
Messages
3,376 (0.54/day)
Location
Athens , GREECE
System Name SECONDARY RIG / PRIMARY RIG / THIRD RIG
Processor i920@3.6GHz / i920@4GHz / AMD Phenom II 955
Motherboard Gigabyte EX58-UD4P / Gigabyte EX58-UD7 / ASRock 890GX3
Cooling CoolIT Domino ALC / Thermalright Silver Arrow / Thermalright VenomousX
Memory 12GB DDR3 @ 1800MHZ / 6GB DDR3 @ 2250MHZ / 4GB DDR3 @ 1600MHZ
Video Card(s) XFX ATI RADEON 5970 / GAINWARD NVIDIA GTX 580 / 2xGEFORCE GTX295
Storage 1550GB / 6TB SAS - SSD / 160GB SSD
Display(s) NEC 26WUXi2 / NEC 3090WQXi / SONY 55A2000 (1080P 55inch)
Case COOLER MASTER HAF 932 / COOLER MASTER ATCS 840 / ANTEC DARKFLEET DF85
Audio Device(s) Soundblaster X-Fi Xtreme Music / SoundBlaster X-Fi Fatal1ty Pro / Realtek Onboard
Power Supply CWT 1200W / Enermax Revolution 85+ 1250W / Ikonik Vulcan 1200W
Software Windows 7 x64 / Windows 7 x64 / Windows 7 x64
Generally sites use games that are most known to people to conduct benchmarks. Another thing is that they may have not figured out a way to run benchmarks with some of the above games.
 

quickie

New Member
Joined
Jul 16, 2007
Messages
238 (0.04/day)
Processor Intel Core 2 Quad Q9300 @3.0Ghz
Motherboard Gigabyte P35-DS3L rev2.0
Cooling Xigamtek S1283, 2x Antec TriCool 120mm Case fans
Memory 2x2GB OCZ, DDR2-800
Video Card(s) ASUS Radeon 3450 256mb
Storage WD 640GB AAKS; WD 500GB AAKS
Display(s) Dell 23" SP2309W
Case Sonata II
Audio Device(s) Audigy 2ZS
Power Supply OCZ GameXStream 700W modded with Scythe SFF21e
I would imagine most review sites use games that will really stress the video card and titles people are familiar with. I don't think Tiger Woods PGA Tour 07 would give many cards a run for their money:)
 
Joined
May 19, 2007
Messages
7,662 (1.25/day)
Location
c:\programs\kitteh.exe
Processor C2Q6600 @ 1.6 GHz
Motherboard Anus PQ5
Cooling ACFPro
Memory GEiL2 x 1 GB PC2 6400
Video Card(s) MSi 4830 (RIP)
Storage Seagate Barracuda 7200.10 320 GB Perpendicular Recording
Display(s) Dell 17'
Case El Cheepo
Audio Device(s) 7.1 Onboard
Power Supply Corsair TX750
Software MCE2K5
DiRT would ..
 

mortal

New Member
Joined
Sep 2, 2006
Messages
151 (0.02/day)
Location
Croatia - Umag
Processor q6600 G0 @ 3400 1,30V
Motherboard DFI LP T2R P35
Cooling Sonic tower @ 40C
Memory 2x1024 Team Elite 4 4 4 12 @ 850mhz
Video Card(s) x1950xtx @ vf-900
Storage Segate 500GB server edition
Display(s) Hanns-g
Case Chieftec LCX Big tower
Audio Device(s) Hercules Muse
Power Supply Silwerstone Strider 560W 12.01-12,04V
I think that they are using games that are very popular, and you can buy it everywhere.
 
Joined
Aug 12, 2006
Messages
3,278 (0.51/day)
Location
UK-small Village in a Valley Near Newcastle
Processor I9 9900KS @ 5.3Ghz
Motherboard Gagabyte z390 Aorus Ultra
Cooling Nexxxos Nova 1080 + 360 rad
Memory 32Gb Crucial Balliastix RGB 4.4GHz
Video Card(s) MSI Gaming X Trio RTX 3090 (Bios and Shunt Modded) 2.17GHz @ 38C
Storage NVME / SSD RAID arrays
Display(s) 38" LG 38GN950-B, 27" BENQ XL2730Z 144hz 1440p, Samsung 27" 3D 1440p
Case Thermaltake Core series
Power Supply 1.6Kw Silverstone
Mouse Roccat Kone EMP
Keyboard Corsair Viper Mechanical
Software Windows 10 Pro
well... we are trying to get benchies etc for call of jaurez.. but no1 else wants to contribute here on tpu :(
 

KennyT772

New Member
Joined
Dec 21, 2005
Messages
3,572 (0.54/day)
System Name Raptor
Processor Intel E8400 Wolfdale @3600
Motherboard Asus P5Q-Pro LGA775
Cooling Zalman CNPS9700
Memory 1024mbx2 Crucial Ballistix DDR800
Video Card(s) XFX 9600GT
Storage Seagate 7200.11 500GB
Display(s) Acer AL2216Wbd and Acer AL1717
Case Gigabyte 3DAurora Black
Audio Device(s) Creative X-Fi Extreme Gamer Faitality
Power Supply OCZ GameXStream 500w
DiRT would ..

You cannot record a time demo or save a replay. In order to benchmark you have to create a set, reproducible path in order to get consistant framerates. Some games such as WoW or oblivion do not have this capability but you can easily reproduce a section just by running there. This is not the case with DiRT.
 

sneekypeet

Retired Super Moderator
Joined
Apr 12, 2006
Messages
29,407 (4.49/day)
System Name EVA-01
Processor Intel i7 13700K
Motherboard Asus ROG Maximus Z690 HERO EVA Edition
Cooling ASUS ROG Ryujin III 360 with Noctua Industrial Fans
Memory PAtriot Viper Elite RGB 96GB @ 6000MHz.
Video Card(s) Asus ROG Strix GeForce RTX 3090 24GB OC EVA Edition
Storage Addlink S95 M.2 PCIe GEN 4x4 2TB
Display(s) Asus ROG SWIFT OLED PG42UQ
Case Thermaltake Core P3 TG
Audio Device(s) Realtek on board > Sony Receiver > Cerwin Vegas
Power Supply be quiet DARK POWER PRO 12 1500W
Mouse ROG STRIX Impact Electro Punk
Keyboard ROG STRIX Scope TKL Electro Punk
Software Windows 11
I would imagine most review sites use games that will really stress the video card and titles people are familiar with. I don't think Tiger Woods PGA Tour 07 would give many cards a run for their money:)

BTW i beg to differ...If i have my system or cards just a little too high 07 will BBSOD my machine where farcry and TOCA will continue to play at those clocks. The only other one i have that may be a bit tougher is COD2. Just my 2 pennies...nothing personal!
 

EastCoasthandle

New Member
Joined
Apr 21, 2005
Messages
6,885 (1.00/day)
System Name MY PC
Processor E8400 @ 3.80Ghz > Q9650 3.60Ghz
Motherboard Maximus Formula
Cooling D5, 7/16" ID Tubing, Maze4 with Fuzion CPU WB
Memory XMS 8500C5D @ 1066MHz
Video Card(s) HD 2900 XT 858/900 to 4870 to 5870 (Keep Vreg area clean)
Storage 2
Display(s) 24"
Case P180
Audio Device(s) X-fi Plantinum
Power Supply Silencer 750
Software XP Pro SP3 to Windows 7
Benchmark Scores This varies from one driver to another.
It would be more diverse to see other titles benchmarked.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,472 (4.25/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
Well the problem is that if they were to add new games they would have to retest those new games with all the old cards previously reviewed so they can have comparisons, which is one of the main points of a review.

Now the problem is that a lot of the reviews are done on cards that aren't actually owned by the reviewer. They are review samples that are given to the reviewer so they can do the review, then they have to give the card back. So they can't go back and retest with the new games, so they can't have comparisons.

Usually a review site picks a set of benchmarks and stick with them to avoid this problem.
 
Joined
Jul 1, 2005
Messages
5,197 (0.76/day)
Location
Kansas City, KS
System Name Dell XPS 15 9560
Processor I7-7700HQ
Memory 32GB DDR4
Video Card(s) GTX 1050/1080 Ti
Storage 1TB SSD
Display(s) 2x Dell P2715Q/4k Internal
Case Razer Core
Audio Device(s) Creative E5/Objective 2 Amp/Senn HD650
Mouse Logitech Proteus Core
Keyboard Logitech G910

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,937 (3.72/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
i think none of these games except for COJ offer any kind of benchmarking mode.

playing each game on each card and then using fraps will just take way too long and wont be precise

if you have suggestions for games which can be automated i'll gladly add them
 

EastCoasthandle

New Member
Joined
Apr 21, 2005
Messages
6,885 (1.00/day)
System Name MY PC
Processor E8400 @ 3.80Ghz > Q9650 3.60Ghz
Motherboard Maximus Formula
Cooling D5, 7/16" ID Tubing, Maze4 with Fuzion CPU WB
Memory XMS 8500C5D @ 1066MHz
Video Card(s) HD 2900 XT 858/900 to 4870 to 5870 (Keep Vreg area clean)
Storage 2
Display(s) 24"
Case P180
Audio Device(s) X-fi Plantinum
Power Supply Silencer 750
Software XP Pro SP3 to Windows 7
Benchmark Scores This varies from one driver to another.
i think none of these games except for COJ offer any kind of benchmarking mode.

playing each game on each card and then using fraps will just take way too long and wont be precise

if you have suggestions for games which can be automated i'll gladly add them

True, part of the problem is that the games don't have a benchmarking tool. However, I do know of a place that has. HOCBench
is just one place that I stumbled upon that offers some sort of benchmarking tool for some games.
 
Last edited:
Joined
Nov 16, 2006
Messages
2,724 (0.43/day)
Location
Blighty
Processor R7 5800x3D
Motherboard MSI x570 Tomahawk
Cooling XSPC Raystorm Edge,EK QS P420M,EK D5pwm Revo Res
Memory 32gb Corsair Vengeance RT 3600 cl16
Video Card(s) Zotac 3070ti Amp Extreme
Storage Samsung 980pro 1tb x2
Display(s) MSI MPG321QRF QD
Case Corsair 7000D
Power Supply EVGA 1000 P2
Mouse G900
Keyboard Corsair k60 RGB PRO
Software Win 11
can you save replays in colin mcrae?, cause then you would have a virtual timedemo (each run of it would be exactly the same)
If i was w1zz i think i would just wait for some benchable directx 10 stuff to come out
 
Joined
Aug 12, 2006
Messages
3,278 (0.51/day)
Location
UK-small Village in a Valley Near Newcastle
Processor I9 9900KS @ 5.3Ghz
Motherboard Gagabyte z390 Aorus Ultra
Cooling Nexxxos Nova 1080 + 360 rad
Memory 32Gb Crucial Balliastix RGB 4.4GHz
Video Card(s) MSI Gaming X Trio RTX 3090 (Bios and Shunt Modded) 2.17GHz @ 38C
Storage NVME / SSD RAID arrays
Display(s) 38" LG 38GN950-B, 27" BENQ XL2730Z 144hz 1440p, Samsung 27" 3D 1440p
Case Thermaltake Core series
Power Supply 1.6Kw Silverstone
Mouse Roccat Kone EMP
Keyboard Corsair Viper Mechanical
Software Windows 10 Pro
call of juarez has a dedicated (and seperate) dx10/9 benchmark program
 

von kain

New Member
Joined
Sep 13, 2006
Messages
780 (0.12/day)
Location
athens/greece
System Name intel-hate
Processor Amd phenom 2 955 @ 3800
Motherboard msi 790fx-gd70
Cooling coolermaster
Memory 4096 @1600 corsair
Video Card(s) sapphire 5770 @950-1350
Storage 1 seagate 80gb sata2 1 160gb seagate sata
Display(s) 20inch wide lg
Power Supply chieftech 750w
Software windows 7 x64
Benchmark Scores nah
well... we are trying to get benchies etc for call of jaurez.. but no1 else wants to contribute here on tpu :(

i know i was curious to see a dx 10 bench but no one really cares...
there is any generic dx 10 game on the stores?? because i want to see the really difference in gpus on dx10 ??








p.s. hd2900xt 320 stream processors must be something on dx10 cause on dx9 isn't
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.22/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
i did video card reviews for a while, and actually the big killer is this - if you use new games in every review, how do you compare it to the other cards you've tested? Your reviews might be a year or two apart, and without using the same programs and the same (or similar) test rig you have no comparison to draw your own conclusions, all you have is FPS numbers with no meaning.

The other reason, is that its very time consuming - if you have a set amount of benchies that you know well, you can learn any flaws/screwups they do and you're fine

Example: Company of heroes 1.70 patch had a memory leak, that repeated runs of the benchmark caused an FPS drop each run. This made reviewers results skewed, as they usually went lowest to highest on the graphics, and the results ended up slower than they should have been. If i threw that in randomly without having tested it first, the results would be completely different to what you'd see testing it yourself, and to actual gameplay.
 
B

bassmasta

Guest
would it be possible, do you think, to start flight simulator x, tip your joystick on it's side (for an ever-lasting loop), then test with fraps? as long as you stopped the test on time, this wouldn't be too hard<.<
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,937 (3.72/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit

KennyT772

New Member
Joined
Dec 21, 2005
Messages
3,572 (0.54/day)
System Name Raptor
Processor Intel E8400 Wolfdale @3600
Motherboard Asus P5Q-Pro LGA775
Cooling Zalman CNPS9700
Memory 1024mbx2 Crucial Ballistix DDR800
Video Card(s) XFX 9600GT
Storage Seagate 7200.11 500GB
Display(s) Acer AL2216Wbd and Acer AL1717
Case Gigabyte 3DAurora Black
Audio Device(s) Creative X-Fi Extreme Gamer Faitality
Power Supply OCZ GameXStream 500w
can you save replays in colin mcrae?, cause then you would have a virtual timedemo (each run of it would be exactly the same)
If i was w1zz i think i would just wait for some benchable directx 10 stuff to come out

I already said you can't if you are referring to DiRT that is. Colib Mcrae 05 isn't the most stressful game anymore.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.22/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
Wizzards TPU bench is awesome :p and it backs up what i said about a standard set of benchmarks, every piece of hardware reviewed here can be compared to others in the same tests.

Bassmasta: Yes, if you want an FPS reading that you cant compare. You cant guarantee its the same every time around (as in, EVERY frame is the same) so you get variations. Theres no point in doing a test like that, if its random how its going to turn out because then you cant compare it to another card/system.
 
B

bassmasta

Guest
Wizzards TPU bench is awesome :p and it backs up what i said about a standard set of benchmarks, every piece of hardware reviewed here can be compared to others in the same tests.

Bassmasta: Yes, if you want an FPS reading that you cant compare. You cant guarantee its the same every time around (as in, EVERY frame is the same) so you get variations. Theres no point in doing a test like that, if its random how its going to turn out because then you cant compare it to another card/system.

fair enough, but as I recall, 3d mark doesn't always give the same test, either. I recall the ragdoll test having a physics and a quality test, neither of which ever turned out exactly the same.
 

Urlyin

I still do pencil mods
Joined
Aug 17, 2004
Messages
2,272 (0.32/day)
fair enough, but as I recall, 3d mark doesn't always give the same test, either. I recall the ragdoll test having a physics and a quality test, neither of which ever turned out exactly the same.

in most cases you run the bench several times and take the average...
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.22/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
and which is why those tests arent part of the default runs either :p
 
Top