• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA A100 Ampere GPU Benchmarked on MLPerf

AleksandarK

Staff member
Joined
Aug 19, 2017
Messages
582 (0.54/day)
When NVIDIA announced its Ampere lineup of the graphics cards, the A100 GPU was there to represent the higher performance of the lineup. The GPU is optimized for heavy computing workloads as well as machine learning and AI tasks. Today, NVIDIA has submitted the MLPerf results on the A100 GPU to the MLPerf database. What is MLPerf and why it matters you might think? Well, MLPerf is a system benchmark designed to test the capability of a system for machine learning tasks and enable comparability between systems. The A100 GPU got benchmarked in the latest 0.7 version of the benchmark.

The baseline for the results was the previous generation king, V100 Volta GPU. The new A100 GPU is average 1.5 to 2.5 times faster compared to V100. So far A100 GPU system beats all offers available. It is worth pointing out that not all competing systems have been submitted, however, so far the A100 GPU is the fastest.


The performance results follow:




View at TechPowerUp Main Site
 
Joined
Sep 17, 2014
Messages
12,726 (5.93/day)
Location
Mars
Processor i7 8700k 4.7Ghz @ 1.26v
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) MSI GTX 1080 Gaming X @ 2100/5500
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Eizo Foris FG2421
Case Fractal Design Define C TG
Power Supply EVGA G2 750w
Mouse Logitech G502 Protheus Spectrum
Keyboard Sharkoon MK80 (Brown)
Software W10 x64
Getting a strong 10 gigarays vibe from these numbers. Can anyone tell what we're really looking at? I also see different versions of software compared along with hardware. What does it compare to anyway?
 
Joined
Jul 10, 2015
Messages
277 (0.15/day)
Location
Sokovia
System Name Alienation from family
Processor i7 7700k
Motherboard Hero VIII
Cooling Macho revB
Memory 16gb Hyperx
Video Card(s) Asus 1080ti Strix OC
Storage 960evo 500gb
Display(s) AOC 4k
Case Define R2 XL
Power Supply Be f*ing Quiet 600W M Gold
Mouse NoName
Keyboard NoNameless HP
Software You have nothing on me
Benchmark Scores Personal record 100m sprint: 60m
Getting a strong 10 gigarays vibe from these numbers. Can anyone tell what we're really looking at? I also see different versions of software compared along with hardware. What does it compare to anyway?
Ampere is faster than Volta, hello.
 
Joined
Sep 17, 2014
Messages
12,726 (5.93/day)
Location
Mars
Processor i7 8700k 4.7Ghz @ 1.26v
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) MSI GTX 1080 Gaming X @ 2100/5500
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Eizo Foris FG2421
Case Fractal Design Define C TG
Power Supply EVGA G2 750w
Mouse Logitech G502 Protheus Spectrum
Keyboard Sharkoon MK80 (Brown)
Software W10 x64
Ampere is faster than Volta, hello.
Hi. We got that, and my question is how much faster really given all the variables.
 
Joined
Aug 13, 2010
Messages
4,686 (1.29/day)
Hi. We got that, and my question is how much faster really given all the variables.
Depending on type of application, seems to be anywhere between 20% and over double.
Its a bit hard to narrow it, since software is still mostly inexperienced with Ampere. My guess is that as the product becomes more widely available, its results and utilization will improve, much like how Turing did.
 
Joined
Jan 31, 2011
Messages
121 (0.03/day)
Getting a strong 10 gigarays vibe from these numbers. Can anyone tell what we're really looking at? I also see different versions of software compared along with hardware. What does it compare to anyway?
mlperf is largely open, so you can see for yourself what loads are being run, at least the reference implementations.

 
Joined
Jan 8, 2017
Messages
5,292 (4.06/day)
System Name Good enough
Processor AMD Ryzen R7 1700X - 4.0 Ghz / 1.350V
Motherboard ASRock B450M Pro4
Cooling Scythe Katana 4 - 3x 120mm case fans
Memory 16GB - Corsair Vengeance LPX
Video Card(s) OEM Dell GTX 1080
Storage 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) 4K Samsung TV
Case Zalman R1
Power Supply 500W
Hi. We got that, and my question is how much faster really given all the variables.
Generic shader performance hasn't increased that much, if that's what you are wondering.
 
Top