Modular performance tables

[GodisanAtheist]

I'm guessing this gets posted here every couple years with new GPU launches, but it would be a neat tool for any CPU/GPU performance data based to be able to select a list of games, and select a list of products (CPUs or GPUs) and have a dynamic table that compares the selected item's relative performance, average FPS, etc. in the games selected.

Hell, let folks enter in their local retail pricing and have the tool sort the selected card's performance/$$$.

Maybe call it the TPU Buyer's Assistant Tool or something.

This was sort of spured by the "outlier" argument where people feel pretty strongly about CS2 skewing results in reviews because Nvidia gets 300 fps and AMD gets 200 fps. It's a popular game and should be tested and reviewed, but I can see the other side of the argument where the game is playable on everything and if you only care about single player games it's actually not doing you the reader any favors by including it.

I'm sure all the data is there on the back end, but have no idea how complicated a tool like this would be to assemble. There would be a huge value to it though and as far as I can tell it would leverage a massive competitive advantage TPU has in their data base over competing review sites.

Thoughts?

 

[lambda]

Isn't this just a lengthy SQL query (including JOIN, nested queries) at end of the day?

 

[dirtyferret]

but it would be a neat tool for any CPU/GPU performance data based

lengthy SQL query

neat 100% but for obvious reasons CPU & GPU reviews get tested with flagship parts so if you want accurate numbers someone is going to have to test all those combos across all those games. So even if you limit it to 12 CPUs and 12 GPUs across 12 games, that's over 1700 tests with us obviously ignoring updates to patches and drivers will also impact performance.

 

[Frick]

That's the thing, someone would have to make A Tool for it. Anandtech had something like it, but I assume they stopped for good reasons.

Isn't this just a lengthy SQL query (including JOIN, nested queries) at end of the day?

With some stuff like rendering graphs on top of it. It would be a really big project and someone good has to commit to it and that someone needs paying and at the end of the day no one knows how popular it'll be.

It'd be great though and I've had similar thoughts in the past but honestly I don't see it, unless there's like external funding for it or something.

 

[dirtyferret]

Anandtech had something like it, but I assume they stopped for good reasons.

their benchmark tool which was great but became a bit convoluted over the years with newer parts and newer versions of benchmarks, still it used flagship hardware to remove as much performance hold back as possible so not the combo performance that I think the OP is looking for.

https://www.anandtech.com/bench/CPU-2024/3385

edit: they offered some combo variations but seemed to stop around 2018

https://www.anandtech.com/bench/CPU/1773

 

[GodisanAtheist]

That's the thing, someone would have to make A Tool for it. Anandtech had something like it, but I assume they stopped for good reasons.


With some stuff like rendering graphs on top of it. It would be a really big project and someone good has to commit to it and that someone needs paying and at the end of the day no one knows how popular it'll be.

It'd be great though and I've had similar thoughts in the past but honestly I don't see it, unless there's like external funding for it or something.

- AnandTech stopped because they basically stopped actually reviewing and testing parts and then slowly died. They missed the GTX960 review and it was all a slow decline into irrelevance from there. Joke on the forums for a long time was "they'll get to reviewing X as soon as the GTX960 testing is done". Ryan's lab burning down was the final nail in the coffin, they never recovered from that.

Naturally trying to compare... a HD7970 to a RTX 5090 isn't going to work and return some kind of error, but let's say I am in the market right now and I want to know if I should get a 9060XT, 5060Ti, or used 3070 and I like to play single player open world games so I pick Witcher 3, Cyberpunk, Hogwarts Legacy and Monster Hunter and I want to know the relative positioning in just those games.

There should be a pretty straightforward way to build some tables on the fly comparing the gathered metrics from those games and ranking the cards, picking which card to pin to 100% etc.