• We've upgraded our forums. Please post any issues/requests in this thread.

Why are we not seeing Video Card reviews using other games?

Joined
Apr 21, 2005
Messages
6,885 (1.49/day)
Likes
1,501
System Name MY PC
Processor E8400 @ 3.80Ghz > Q9650 3.60Ghz
Motherboard Maximus Formula
Cooling D5, 7/16" ID Tubing, Maze4 with Fuzion CPU WB
Memory XMS 8500C5D @ 1066MHz
Video Card(s) HD 2900 XT 858/900 to 4870 to 5870 (Keep Vreg area clean)
Storage 2
Display(s) 24"
Case P180
Audio Device(s) X-fi Plantinum
Power Supply Silencer 750
Software XP Pro SP3 to Windows 7
Benchmark Scores This varies from one driver to another.
#1
For example a few from the following:
-Dirt
-Graw2
-The Chronicles Of Riddick <-awesome
-Lost Planet
-Call of Juarez
-Test Drive

Others include:
-Tiger Woods PGA Tour 07
-FIFA Soccer 07
-NBA Live 08
-Flight Simulator X Deluxe
-Close Combat: First to Fight

Just to name a few. I am not saying that all of these be used. What I am saying is that everyone doesn't/no longer plays Fear, BF2142, Quake 4, etc. A little diversity would be nice.
 
Last edited:
Joined
Jan 19, 2007
Messages
3,376 (0.85/day)
Likes
161
Location
Athens , GREECE
System Name SECONDARY RIG / PRIMARY RIG / THIRD RIG
Processor i920@3.6GHz / i920@4GHz / AMD Phenom II 955
Motherboard Gigabyte EX58-UD4P / Gigabyte EX58-UD7 / ASRock 890GX3
Cooling CoolIT Domino ALC / Thermalright Silver Arrow / Thermalright VenomousX
Memory 12GB DDR3 @ 1800MHZ / 6GB DDR3 @ 2250MHZ / 4GB DDR3 @ 1600MHZ
Video Card(s) XFX ATI RADEON 5970 / GAINWARD NVIDIA GTX 580 / 2xGEFORCE GTX295
Storage 1550GB / 6TB SAS - SSD / 160GB SSD
Display(s) NEC 26WUXi2 / NEC 3090WQXi / SONY 55A2000 (1080P 55inch)
Case COOLER MASTER HAF 932 / COOLER MASTER ATCS 840 / ANTEC DARKFLEET DF85
Audio Device(s) Soundblaster X-Fi Xtreme Music / SoundBlaster X-Fi Fatal1ty Pro / Realtek Onboard
Power Supply CWT 1200W / Enermax Revolution 85+ 1250W / Ikonik Vulcan 1200W
Software Windows 7 x64 / Windows 7 x64 / Windows 7 x64
#2
Generally sites use games that are most known to people to conduct benchmarks. Another thing is that they may have not figured out a way to run benchmarks with some of the above games.
 

quickie

New Member
Joined
Jul 16, 2007
Messages
238 (0.06/day)
Likes
26
Processor Intel Core 2 Quad Q9300 @3.0Ghz
Motherboard Gigabyte P35-DS3L rev2.0
Cooling Xigamtek S1283, 2x Antec TriCool 120mm Case fans
Memory 2x2GB OCZ, DDR2-800
Video Card(s) ASUS Radeon 3450 256mb
Storage WD 640GB AAKS; WD 500GB AAKS
Display(s) Dell 23" SP2309W
Case Sonata II
Audio Device(s) Audigy 2ZS
Power Supply OCZ GameXStream 700W modded with Scythe SFF21e
#3
I would imagine most review sites use games that will really stress the video card and titles people are familiar with. I don't think Tiger Woods PGA Tour 07 would give many cards a run for their money:)
 
Joined
May 19, 2007
Messages
7,662 (1.99/day)
Likes
536
Location
c:\programs\kitteh.exe
Processor C2Q6600 @ 1.6 GHz
Motherboard Anus PQ5
Cooling ACFPro
Memory GEiL2 x 1 GB PC2 6400
Video Card(s) MSi 4830 (RIP)
Storage Seagate Barracuda 7200.10 320 GB Perpendicular Recording
Display(s) Dell 17'
Case El Cheepo
Audio Device(s) 7.1 Onboard
Power Supply Corsair TX750
Software MCE2K5
#4
DiRT would ..
 

mortal

New Member
Joined
Sep 2, 2006
Messages
151 (0.04/day)
Likes
7
Location
Croatia - Umag
Processor q6600 G0 @ 3400 1,30V
Motherboard DFI LP T2R P35
Cooling Sonic tower @ 40C
Memory 2x1024 Team Elite 4 4 4 12 @ 850mhz
Video Card(s) x1950xtx @ vf-900
Storage Segate 500GB server edition
Display(s) Hanns-g
Case Chieftec LCX Big tower
Audio Device(s) Hercules Muse
Power Supply Silwerstone Strider 560W 12.01-12,04V
#5
I think that they are using games that are very popular, and you can buy it everywhere.
 
Joined
Aug 12, 2006
Messages
3,252 (0.79/day)
Likes
146
Location
UK-small Village in a Valley Near Newcastle
Processor I7 7700k De-lid @ 5GHz
Motherboard Asus Maximus Hero IX
Cooling Custom dual 360 rad loops. Cpu monoblock, 295x2 full cover waterblock. Custom R9290x waterblock.
Memory 16Gb Team Xtream DDR4 3600MHz
Video Card(s) 295X2 + R9290X
Storage SSD RAID array, dozen TB HDD's in RAID
Display(s) 27" BENQ XL2730Z 144hz 1440p, Samsung 27" 3D 1440p, QNIX 144p @ 100Hz overclocked
Case Thermaltake Core series
Power Supply 1.5Kw
Mouse RAT 7
Keyboard Ryos II MK Pro Mechanical
Software Windows 10 LTSB
#6
well... we are trying to get benchies etc for call of jaurez.. but no1 else wants to contribute here on tpu :(
 

KennyT772

New Member
Joined
Dec 21, 2005
Messages
3,572 (0.82/day)
Likes
102
System Name Raptor
Processor Intel E8400 Wolfdale @3600
Motherboard Asus P5Q-Pro LGA775
Cooling Zalman CNPS9700
Memory 1024mbx2 Crucial Ballistix DDR800
Video Card(s) XFX 9600GT
Storage Seagate 7200.11 500GB
Display(s) Acer AL2216Wbd and Acer AL1717
Case Gigabyte 3DAurora Black
Audio Device(s) Creative X-Fi Extreme Gamer Faitality
Power Supply OCZ GameXStream 500w
#7
You cannot record a time demo or save a replay. In order to benchmark you have to create a set, reproducible path in order to get consistant framerates. Some games such as WoW or oblivion do not have this capability but you can easily reproduce a section just by running there. This is not the case with DiRT.
 

sneekypeet

Unpaid Babysitter
Staff member
Joined
Apr 12, 2006
Messages
24,613 (5.77/day)
Likes
9,341
System Name His
Processor Intel i7 5930K
Motherboard Asus Maximus V Extreme
Cooling Thermalright True Spirit 140 BW Rev.A
Memory Corsair Dominator Platinum ROG
Video Card(s) nVidia GTX 1080 SLI with EVGA Hybrid coolers.
Storage Samsung 960 Pro / Crucial MX300 750GB / Seagate 1TB Spinner
Display(s) Sony 43" 4K 60hz
Case SilverStone Temjin TJ11
Audio Device(s) Realtek on board > Sony receiver > Cerwin Vega's
Power Supply Thermaltake TPSG 1050W
Mouse Always Changing
Keyboard Always Changing
Software Windows 10 Pro 64
#8
I would imagine most review sites use games that will really stress the video card and titles people are familiar with. I don't think Tiger Woods PGA Tour 07 would give many cards a run for their money:)
BTW i beg to differ...If i have my system or cards just a little too high 07 will BBSOD my machine where farcry and TOCA will continue to play at those clocks. The only other one i have that may be a bit tougher is COD2. Just my 2 pennies...nothing personal!
 
Joined
Apr 21, 2005
Messages
6,885 (1.49/day)
Likes
1,501
System Name MY PC
Processor E8400 @ 3.80Ghz > Q9650 3.60Ghz
Motherboard Maximus Formula
Cooling D5, 7/16" ID Tubing, Maze4 with Fuzion CPU WB
Memory XMS 8500C5D @ 1066MHz
Video Card(s) HD 2900 XT 858/900 to 4870 to 5870 (Keep Vreg area clean)
Storage 2
Display(s) 24"
Case P180
Audio Device(s) X-fi Plantinum
Power Supply Silencer 750
Software XP Pro SP3 to Windows 7
Benchmark Scores This varies from one driver to another.
#9
It would be more diverse to see other titles benchmarked.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
24,274 (5.51/day)
Likes
10,361
Location
Indiana, USA
Processor Intel Core i7 4790K@4.6GHz
Motherboard AsRock Z97 Extreme6
Cooling Corsair H100i
Memory 32GB Corsair DDR3-1866 9-10-9-27
Video Card(s) ASUS GTX960 STRIX @ 1500/1900
Storage 480GB Crucial MX200 + 2TB Seagate Solid State Hybrid Drive with 128GB OCZ Synapse SSD Cache
Display(s) QNIX QX2710 1440p@120Hz
Case Corsair 650D Black
Audio Device(s) Onboard is good enough for me
Power Supply Corsair HX850
Software Windows 10 Pro x64
#10
Well the problem is that if they were to add new games they would have to retest those new games with all the old cards previously reviewed so they can have comparisons, which is one of the main points of a review.

Now the problem is that a lot of the reviews are done on cards that aren't actually owned by the reviewer. They are review samples that are given to the reviewer so they can do the review, then they have to give the card back. So they can't go back and retest with the new games, so they can't have comparisons.

Usually a review site picks a set of benchmarks and stick with them to avoid this problem.
 
Joined
Jul 1, 2005
Messages
5,196 (1.14/day)
Likes
296
Location
Kansas City, KS
System Name Dell XPS 15 9560
Processor I7-7700HQ
Memory 32GB DDR4
Video Card(s) GTX 1050/1080 Ti
Storage 1TB SSD
Display(s) 2x Dell P2715Q/4k Internal
Case Razer Core
Audio Device(s) Creative E5/Objective 2 Amp/Senn HD650
Mouse Logitech Proteus Core
Keyboard Logitech G910
#11

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
17,027 (3.43/day)
Likes
17,894
Processor Core i7-4790K
Memory 16 GB
Video Card(s) GTX 1080
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 7
#12
i think none of these games except for COJ offer any kind of benchmarking mode.

playing each game on each card and then using fraps will just take way too long and wont be precise

if you have suggestions for games which can be automated i'll gladly add them
 
Joined
Apr 21, 2005
Messages
6,885 (1.49/day)
Likes
1,501
System Name MY PC
Processor E8400 @ 3.80Ghz > Q9650 3.60Ghz
Motherboard Maximus Formula
Cooling D5, 7/16" ID Tubing, Maze4 with Fuzion CPU WB
Memory XMS 8500C5D @ 1066MHz
Video Card(s) HD 2900 XT 858/900 to 4870 to 5870 (Keep Vreg area clean)
Storage 2
Display(s) 24"
Case P180
Audio Device(s) X-fi Plantinum
Power Supply Silencer 750
Software XP Pro SP3 to Windows 7
Benchmark Scores This varies from one driver to another.
#13
i think none of these games except for COJ offer any kind of benchmarking mode.

playing each game on each card and then using fraps will just take way too long and wont be precise

if you have suggestions for games which can be automated i'll gladly add them
True, part of the problem is that the games don't have a benchmarking tool. However, I do know of a place that has. HOCBench
is just one place that I stumbled upon that offers some sort of benchmarking tool for some games.
 
Last edited:
Joined
Nov 16, 2006
Messages
2,717 (0.67/day)
Likes
445
Location
Blighty
System Name Skylake / Sandybridge
Processor i7 6700k@4.8 / i5 2500k@4.6
Motherboard Asus Maximus VIII Ranger / Asrock z68 Extreme4 g3
Cooling EK Supremacy MX, CoolGate 240,EK D5pwm Revo Res/ EK Supreme, swiftech 240 rad, D5 non vario
Memory 16gb G.Skill Trident Z 16gb cl16 / 16gb Corsair Vengeance Pro 2400@2133cl9
Video Card(s) Asus Strix 1070 / Powercolor R9 390 PCS+
Storage Samsung SM961 256gb,BX100 250gb ,kc400 512gb/ 120gb Corsair Force GT, HyperX Savage 240gb,
Display(s) Panasonic 50dx700 tv + Dell u2515 / Dell u2312
Case TTake Suppressor F51/F31
Power Supply EVGA 1000 P2 / EVGA 650 G2
Mouse G900 / G700s
Keyboard Roccat Suora FX Brown / Microsoft Sidewinder X4
Software Win 10 / Win 10
#14
can you save replays in colin mcrae?, cause then you would have a virtual timedemo (each run of it would be exactly the same)
If i was w1zz i think i would just wait for some benchable directx 10 stuff to come out
 
Joined
Aug 12, 2006
Messages
3,252 (0.79/day)
Likes
146
Location
UK-small Village in a Valley Near Newcastle
Processor I7 7700k De-lid @ 5GHz
Motherboard Asus Maximus Hero IX
Cooling Custom dual 360 rad loops. Cpu monoblock, 295x2 full cover waterblock. Custom R9290x waterblock.
Memory 16Gb Team Xtream DDR4 3600MHz
Video Card(s) 295X2 + R9290X
Storage SSD RAID array, dozen TB HDD's in RAID
Display(s) 27" BENQ XL2730Z 144hz 1440p, Samsung 27" 3D 1440p, QNIX 144p @ 100Hz overclocked
Case Thermaltake Core series
Power Supply 1.5Kw
Mouse RAT 7
Keyboard Ryos II MK Pro Mechanical
Software Windows 10 LTSB
#15
call of juarez has a dedicated (and seperate) dx10/9 benchmark program
 

von kain

New Member
Joined
Sep 13, 2006
Messages
780 (0.19/day)
Likes
47
Location
athens/greece
System Name intel-hate
Processor Amd phenom 2 955 @ 3800
Motherboard msi 790fx-gd70
Cooling coolermaster
Memory 4096 @1600 corsair
Video Card(s) sapphire 5770 @950-1350
Storage 1 seagate 80gb sata2 1 160gb seagate sata
Display(s) 20inch wide lg
Power Supply chieftech 750w
Software windows 7 x64
Benchmark Scores nah
#16
well... we are trying to get benchies etc for call of jaurez.. but no1 else wants to contribute here on tpu :(
i know i was curious to see a dx 10 bench but no one really cares...
there is any generic dx 10 game on the stores?? because i want to see the really difference in gpus on dx10 ??








p.s. hd2900xt 320 stream processors must be something on dx10 cause on dx9 isn't
 

Mussels

Moderprator
Staff member
Joined
Oct 6, 2004
Messages
46,100 (9.57/day)
Likes
13,526
Location
Australalalalalaia.
System Name Daddy Long Legs
Processor Ryzen R7 1700, 3.9GHz 1.375v
Motherboard MSI X370 Gaming PRO carbon
Cooling Fractal Celsius S24 (Silent fans, meh pump)
Memory 16GB 2133 generic @ 2800
Video Card(s) MSI GTX 1080 Gaming X (BIOS modded to Gaming Z - faster and solved black screen bugs!)
Storage 1TB Intel SSD Pro 6000p (60TB USB3 storage)
Display(s) Samsung 4K 40" HDTV (UA40KU6000WXXY) / 27" Qnix 2K 110Hz
Case Fractal Design R5. So much room, so quiet...
Audio Device(s) Pioneer VSX-519V + Yamaha YHT-270 / sennheiser HD595/518 + bob marley zion's
Power Supply Corsair HX 750i (Platinum, fan off til 300W)
Mouse Logitech G403 + KKmoon desk-sized mousepad
Keyboard Corsair K65 Rapidfire
Software Windows 10 pro x64 (all systems)
Benchmark Scores Laptops: i7-4510U + 840M 2GB (touchscreen) 275GB SSD + 16GB i7-2630QM + GT 540M + 8GB
#17
i did video card reviews for a while, and actually the big killer is this - if you use new games in every review, how do you compare it to the other cards you've tested? Your reviews might be a year or two apart, and without using the same programs and the same (or similar) test rig you have no comparison to draw your own conclusions, all you have is FPS numbers with no meaning.

The other reason, is that its very time consuming - if you have a set amount of benchies that you know well, you can learn any flaws/screwups they do and you're fine

Example: Company of heroes 1.70 patch had a memory leak, that repeated runs of the benchmark caused an FPS drop each run. This made reviewers results skewed, as they usually went lowest to highest on the graphics, and the results ended up slower than they should have been. If i threw that in randomly without having tested it first, the results would be completely different to what you'd see testing it yourself, and to actual gameplay.
 
B

bassmasta

Guest
#18
would it be possible, do you think, to start flight simulator x, tip your joystick on it's side (for an ever-lasting loop), then test with fraps? as long as you stopped the test on time, this wouldn't be too hard<.<
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
17,027 (3.43/day)
Likes
17,894
Processor Core i7-4790K
Memory 16 GB
Video Card(s) GTX 1080
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 7
#19

KennyT772

New Member
Joined
Dec 21, 2005
Messages
3,572 (0.82/day)
Likes
102
System Name Raptor
Processor Intel E8400 Wolfdale @3600
Motherboard Asus P5Q-Pro LGA775
Cooling Zalman CNPS9700
Memory 1024mbx2 Crucial Ballistix DDR800
Video Card(s) XFX 9600GT
Storage Seagate 7200.11 500GB
Display(s) Acer AL2216Wbd and Acer AL1717
Case Gigabyte 3DAurora Black
Audio Device(s) Creative X-Fi Extreme Gamer Faitality
Power Supply OCZ GameXStream 500w
#20
can you save replays in colin mcrae?, cause then you would have a virtual timedemo (each run of it would be exactly the same)
If i was w1zz i think i would just wait for some benchable directx 10 stuff to come out
I already said you can't if you are referring to DiRT that is. Colib Mcrae 05 isn't the most stressful game anymore.
 

Mussels

Moderprator
Staff member
Joined
Oct 6, 2004
Messages
46,100 (9.57/day)
Likes
13,526
Location
Australalalalalaia.
System Name Daddy Long Legs
Processor Ryzen R7 1700, 3.9GHz 1.375v
Motherboard MSI X370 Gaming PRO carbon
Cooling Fractal Celsius S24 (Silent fans, meh pump)
Memory 16GB 2133 generic @ 2800
Video Card(s) MSI GTX 1080 Gaming X (BIOS modded to Gaming Z - faster and solved black screen bugs!)
Storage 1TB Intel SSD Pro 6000p (60TB USB3 storage)
Display(s) Samsung 4K 40" HDTV (UA40KU6000WXXY) / 27" Qnix 2K 110Hz
Case Fractal Design R5. So much room, so quiet...
Audio Device(s) Pioneer VSX-519V + Yamaha YHT-270 / sennheiser HD595/518 + bob marley zion's
Power Supply Corsair HX 750i (Platinum, fan off til 300W)
Mouse Logitech G403 + KKmoon desk-sized mousepad
Keyboard Corsair K65 Rapidfire
Software Windows 10 pro x64 (all systems)
Benchmark Scores Laptops: i7-4510U + 840M 2GB (touchscreen) 275GB SSD + 16GB i7-2630QM + GT 540M + 8GB
#21
Wizzards TPU bench is awesome :p and it backs up what i said about a standard set of benchmarks, every piece of hardware reviewed here can be compared to others in the same tests.

Bassmasta: Yes, if you want an FPS reading that you cant compare. You cant guarantee its the same every time around (as in, EVERY frame is the same) so you get variations. Theres no point in doing a test like that, if its random how its going to turn out because then you cant compare it to another card/system.
 
B

bassmasta

Guest
#22
Wizzards TPU bench is awesome :p and it backs up what i said about a standard set of benchmarks, every piece of hardware reviewed here can be compared to others in the same tests.

Bassmasta: Yes, if you want an FPS reading that you cant compare. You cant guarantee its the same every time around (as in, EVERY frame is the same) so you get variations. Theres no point in doing a test like that, if its random how its going to turn out because then you cant compare it to another card/system.
fair enough, but as I recall, 3d mark doesn't always give the same test, either. I recall the ragdoll test having a physics and a quality test, neither of which ever turned out exactly the same.
 

Urlyin

Senior Moderator
Joined
Aug 17, 2004
Messages
2,260 (0.46/day)
Likes
129
#23
fair enough, but as I recall, 3d mark doesn't always give the same test, either. I recall the ragdoll test having a physics and a quality test, neither of which ever turned out exactly the same.
in most cases you run the bench several times and take the average...
 

Mussels

Moderprator
Staff member
Joined
Oct 6, 2004
Messages
46,100 (9.57/day)
Likes
13,526
Location
Australalalalalaia.
System Name Daddy Long Legs
Processor Ryzen R7 1700, 3.9GHz 1.375v
Motherboard MSI X370 Gaming PRO carbon
Cooling Fractal Celsius S24 (Silent fans, meh pump)
Memory 16GB 2133 generic @ 2800
Video Card(s) MSI GTX 1080 Gaming X (BIOS modded to Gaming Z - faster and solved black screen bugs!)
Storage 1TB Intel SSD Pro 6000p (60TB USB3 storage)
Display(s) Samsung 4K 40" HDTV (UA40KU6000WXXY) / 27" Qnix 2K 110Hz
Case Fractal Design R5. So much room, so quiet...
Audio Device(s) Pioneer VSX-519V + Yamaha YHT-270 / sennheiser HD595/518 + bob marley zion's
Power Supply Corsair HX 750i (Platinum, fan off til 300W)
Mouse Logitech G403 + KKmoon desk-sized mousepad
Keyboard Corsair K65 Rapidfire
Software Windows 10 pro x64 (all systems)
Benchmark Scores Laptops: i7-4510U + 840M 2GB (touchscreen) 275GB SSD + 16GB i7-2630QM + GT 540M + 8GB
#24
and which is why those tests arent part of the default runs either :p