1. Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Why are we not seeing Video Card reviews using other games?

Discussion in 'Graphics Cards' started by EastCoasthandle, Jul 24, 2007.

  1. EastCoasthandle

    EastCoasthandle New Member

    Joined:
    Apr 21, 2005
    Messages:
    6,889 (1.99/day)
    Thanks Received:
    1,505
    For example a few from the following:
    -Dirt
    -Graw2
    -The Chronicles Of Riddick <-awesome
    -Lost Planet
    -Call of Juarez
    -Test Drive

    Others include:
    -Tiger Woods PGA Tour 07
    -FIFA Soccer 07
    -NBA Live 08
    -Flight Simulator X Deluxe
    -Close Combat: First to Fight

    Just to name a few. I am not saying that all of these be used. What I am saying is that everyone doesn't/no longer plays Fear, BF2142, Quake 4, etc. A little diversity would be nice.
     
    Last edited: Jul 26, 2007
  2. HellasVagabond New Member

    Joined:
    Jan 19, 2007
    Messages:
    3,404 (1.20/day)
    Thanks Received:
    162
    Location:
    Athens , GREECE
    Generally sites use games that are most known to people to conduct benchmarks. Another thing is that they may have not figured out a way to run benchmarks with some of the above games.
     
  3. quickie New Member

    Joined:
    Jul 16, 2007
    Messages:
    238 (0.09/day)
    Thanks Received:
    26
    I would imagine most review sites use games that will really stress the video card and titles people are familiar with. I don't think Tiger Woods PGA Tour 07 would give many cards a run for their money:)
     
  4. [I.R.A]_FBi

    [I.R.A]_FBi New Member

    Joined:
    May 19, 2007
    Messages:
    7,664 (2.82/day)
    Thanks Received:
    540
    Location:
    c:\programs\kitteh.exe
    DiRT would ..
     
  5. mortal New Member

    Joined:
    Sep 2, 2006
    Messages:
    151 (0.05/day)
    Thanks Received:
    7
    Location:
    Croatia - Umag
    I think that they are using games that are very popular, and you can buy it everywhere.
     
  6. mandelore

    mandelore New Member

    Joined:
    Aug 12, 2006
    Messages:
    3,251 (1.09/day)
    Thanks Received:
    152
    Location:
    UK-small Village in a Valley Near Newcastle
    well... we are trying to get benchies etc for call of jaurez.. but no1 else wants to contribute here on tpu :(
     
  7. KennyT772

    KennyT772 New Member

    Joined:
    Dec 21, 2005
    Messages:
    3,585 (1.11/day)
    Thanks Received:
    103
    You cannot record a time demo or save a replay. In order to benchmark you have to create a set, reproducible path in order to get consistant framerates. Some games such as WoW or oblivion do not have this capability but you can easily reproduce a section just by running there. This is not the case with DiRT.
     
  8. sneekypeet

    sneekypeet Unpaid Babysitter Staff Member

    Joined:
    Apr 12, 2006
    Messages:
    21,612 (6.94/day)
    Thanks Received:
    6,138
    BTW i beg to differ...If i have my system or cards just a little too high 07 will BBSOD my machine where farcry and TOCA will continue to play at those clocks. The only other one i have that may be a bit tougher is COD2. Just my 2 pennies...nothing personal!
     
  9. EastCoasthandle

    EastCoasthandle New Member

    Joined:
    Apr 21, 2005
    Messages:
    6,889 (1.99/day)
    Thanks Received:
    1,505
    It would be more diverse to see other titles benchmarked.
     
  10. newtekie1

    newtekie1 Semi-Retired Folder

    Joined:
    Nov 22, 2005
    Messages:
    20,029 (6.15/day)
    Thanks Received:
    6,094
    Well the problem is that if they were to add new games they would have to retest those new games with all the old cards previously reviewed so they can have comparisons, which is one of the main points of a review.

    Now the problem is that a lot of the reviews are done on cards that aren't actually owned by the reviewer. They are review samples that are given to the reviewer so they can do the review, then they have to give the card back. So they can't go back and retest with the new games, so they can't have comparisons.

    Usually a review site picks a set of benchmarks and stick with them to avoid this problem.
     
    Crunching for Team TPU 50 Million points folded for TPU
  11. Dippyskoodlez

    Joined:
    Jul 1, 2005
    Messages:
    5,097 (1.50/day)
    Thanks Received:
    238
    Location:
    Kansas City, KS
    Would be nice to see a more diverse set of games with a benchmark mode too. ;)
     
  12. W1zzard

    W1zzard Administrator Staff Member

    Joined:
    May 14, 2004
    Messages:
    14,952 (3.92/day)
    Thanks Received:
    11,753
    i think none of these games except for COJ offer any kind of benchmarking mode.

    playing each game on each card and then using fraps will just take way too long and wont be precise

    if you have suggestions for games which can be automated i'll gladly add them
     
  13. EastCoasthandle

    EastCoasthandle New Member

    Joined:
    Apr 21, 2005
    Messages:
    6,889 (1.99/day)
    Thanks Received:
    1,505
    True, part of the problem is that the games don't have a benchmarking tool. However, I do know of a place that has. HOCBench
    is just one place that I stumbled upon that offers some sort of benchmarking tool for some games.
     
    Last edited: Jul 26, 2007
  14. Grings

    Grings New Member

    Joined:
    Nov 16, 2006
    Messages:
    2,303 (0.79/day)
    Thanks Received:
    184
    Location:
    Blighty
    can you save replays in colin mcrae?, cause then you would have a virtual timedemo (each run of it would be exactly the same)
    If i was w1zz i think i would just wait for some benchable directx 10 stuff to come out
     
  15. mandelore

    mandelore New Member

    Joined:
    Aug 12, 2006
    Messages:
    3,251 (1.09/day)
    Thanks Received:
    152
    Location:
    UK-small Village in a Valley Near Newcastle
    call of juarez has a dedicated (and seperate) dx10/9 benchmark program
     
  16. von kain New Member

    Joined:
    Sep 13, 2006
    Messages:
    782 (0.26/day)
    Thanks Received:
    49
    Location:
    athens/greece
    i know i was curious to see a dx 10 bench but no one really cares...
    there is any generic dx 10 game on the stores?? because i want to see the really difference in gpus on dx10 ??








    p.s. hd2900xt 320 stream processors must be something on dx10 cause on dx9 isn't
     
  17. Mussels

    Mussels Moderprator Staff Member

    Joined:
    Oct 6, 2004
    Messages:
    42,369 (11.55/day)
    Thanks Received:
    9,673
    i did video card reviews for a while, and actually the big killer is this - if you use new games in every review, how do you compare it to the other cards you've tested? Your reviews might be a year or two apart, and without using the same programs and the same (or similar) test rig you have no comparison to draw your own conclusions, all you have is FPS numbers with no meaning.

    The other reason, is that its very time consuming - if you have a set amount of benchies that you know well, you can learn any flaws/screwups they do and you're fine

    Example: Company of heroes 1.70 patch had a memory leak, that repeated runs of the benchmark caused an FPS drop each run. This made reviewers results skewed, as they usually went lowest to highest on the graphics, and the results ended up slower than they should have been. If i threw that in randomly without having tested it first, the results would be completely different to what you'd see testing it yourself, and to actual gameplay.
     
  18. bassmasta Guest

    would it be possible, do you think, to start flight simulator x, tip your joystick on it's side (for an ever-lasting loop), then test with fraps? as long as you stopped the test on time, this wouldn't be too hard<.<
     
  19. W1zzard

    W1zzard Administrator Staff Member

    Joined:
    May 14, 2004
    Messages:
    14,952 (3.92/day)
    Thanks Received:
    11,753
    uh ya .. i wrote tpubench http://www.techpowerup.com/tpubench which has a ton of plugins and works better for me than this hoc stuff :)
     
  20. KennyT772

    KennyT772 New Member

    Joined:
    Dec 21, 2005
    Messages:
    3,585 (1.11/day)
    Thanks Received:
    103
    I already said you can't if you are referring to DiRT that is. Colib Mcrae 05 isn't the most stressful game anymore.
     
  21. Mussels

    Mussels Moderprator Staff Member

    Joined:
    Oct 6, 2004
    Messages:
    42,369 (11.55/day)
    Thanks Received:
    9,673
    Wizzards TPU bench is awesome :p and it backs up what i said about a standard set of benchmarks, every piece of hardware reviewed here can be compared to others in the same tests.

    Bassmasta: Yes, if you want an FPS reading that you cant compare. You cant guarantee its the same every time around (as in, EVERY frame is the same) so you get variations. Theres no point in doing a test like that, if its random how its going to turn out because then you cant compare it to another card/system.
     
  22. bassmasta Guest

    fair enough, but as I recall, 3d mark doesn't always give the same test, either. I recall the ragdoll test having a physics and a quality test, neither of which ever turned out exactly the same.
     
  23. Urlyin

    Urlyin Senior Moderator

    Joined:
    Aug 17, 2004
    Messages:
    2,337 (0.63/day)
    Thanks Received:
    125
    in most cases you run the bench several times and take the average...
     
  24. Mussels

    Mussels Moderprator Staff Member

    Joined:
    Oct 6, 2004
    Messages:
    42,369 (11.55/day)
    Thanks Received:
    9,673
    and which is why those tests arent part of the default runs either :p
     

Currently Active Users Viewing This Thread: 1 (0 members and 1 guest)

Share This Page