Friday, August 16th 2024

Geekbench AI Hits 1.0 Release: CPUs, GPUs, and NPUs Finally Get AI Benchmarking Solution

Primate Labs, the developer behind the popular Geekbench benchmarking suite, has launched Geekbench AI—a comprehensive benchmark tool designed to measure the artificial intelligence capabilities of various devices. Geekbench AI, previously known as Geekbench ML during its preview phase, has now reached version 1.0. The benchmark is available on multiple operating systems, including Windows, Linux, macOS, Android, and iOS, making it accessible to many users and developers. One of Geekbench AI's key features is its multifaceted approach to scoring. The benchmark utilizes three distinct precision levels: single-precision, half-precision, and quantized data. This evaluation aims to provide a more accurate representation of AI performance across different hardware designs.

In addition to speed, Geekbench AI places a strong emphasis on accuracy. The benchmark assesses how closely each test's output matches the expected results, offering insights into the trade-offs between performance and precision. The release of Geekbench AI 1.0 brings support for new frameworks, including OpenVINO, ONNX, and Qualcomm QNN, expanding its compatibility across various platforms. Primate Labs has also implemented measures to ensure fair comparisons, such as enforcing minimum runtime durations for each workload. The company noted that Samsung and NVIDIA are already utilizing the software to measure their chip performance in-house, showing that adoption is already strong. While the benchmark provides valuable insights, real-world AI applications are still limited, and reliance on a few benchmarks may paint a partial picture. Nevertheless, Geekbench AI represents a significant step forward in standardizing AI performance measurement, potentially influencing future consumer choices in the AI-driven tech market. Results from the benchmark runs can be seen here.
Sources: Geekbench, via Tom's Hardware
Add your own comment

6 Comments on Geekbench AI Hits 1.0 Release: CPUs, GPUs, and NPUs Finally Get AI Benchmarking Solution

#1
kondamin
Wooow a real world use for an npu, now people will have a reason to get one so they can overclock them and compare the number.
Posted on Reply
#2
KLMR
All we were waiting for!
Posted on Reply
#3
Sandbo
Not bad, just in time to put all the platform, Qualcomm, Intel, AMD and Apple on the same bench.
Posted on Reply
#4
Od1sseas
Quantized Score? What is that.
Posted on Reply
#5
Lynxx83
Are Intel Arc GPUs supported by Geekbench AI ?

if yes, any results to share / link to ? :)

btw, are Intel Arc GPUs still unsupported in Cinebench / Maxon Redshift ?
(which is a shame, imho... really :( )
Posted on Reply
#6
InVasMani
Od1sseasQuantized Score? What is that.
Something along the lines of temporal sub pixel processing I believe. So kind of like weighted prompt inference processing capabilities I guess.
Posted on Reply
Oct 10th, 2024 23:16 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts