• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA's Next-Generation "Ampere" GPUs Could Have 18 TeraFLOPs of Compute Performance

Joined
Aug 19, 2017
Messages
332 (0.36/day)
NVIDIA will soon launch its next-generation lineup of graphics cards based on a new and improved "Ampere" architecture. With the first Tesla server cards that are a part of the Ampere lineup going inside Indiana University Big Red 200 supercomputer, we now have some potential specifications and information about its compute performance. Thanks to the Twitter user dylan552p(@dylan522p), who did some math about the potential compute performance of the Ampere GPUs based on NextPlatform's report, we discovered that Ampere is potentially going to feature up to 18 TeraFLOPs of FP64 compute performance.

With Big Red 200 supercomputer being based on Cray's Shasta supercomputer building block, it is being deployed in two phases. The first phase is the deployment of 672 dual-socket nodes powered by AMD's EPYC 7742 "Rome" processors. These CPUs provide 3.15 PetaFLOPs of combined FP64 performance. With a total of 8 PetaFLOPs planned to be achieved by the Big Red 200, that leaves just a bit under 5 PetaFLOPs to be had using GPU+CPU enabled system. Considering the configuration of a node that contains one next-generation AMD "Milan" 64 core CPU, and four of NVIDIA's "Ampere" GPUs alongside it. If we take for a fact that Milan boosts FP64 performance by 25% compared to Rome, then the math shows that the 256 GPUs that will be delivered in the second phase of Big Red 200 deployment will feature up to 18 TeraFLOPs of FP64 compute performance. Even if "Milan" doubles the FP64 compute power of "Rome", there will be around 17.6 TeraFLOPs of FP64 performance for the GPU.


View at TechPowerUp Main Site
 
Joined
May 31, 2016
Messages
1,572 (1.15/day)
System Name Bro2
Processor Ryzen 2700X
Motherboard MSI X470 Gaming Carbon
Cooling Corsair h115i pro rgb
Memory G.Skill Flare X 3200 CL14
Video Card(s) RX Vega 64 Red Devil
Storage M.2 Samsung Evo 970 250MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD
Case Fractal Design G
Audio Device(s) realtec 5.1
Power Supply Corsair AXi 760W
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
With NV I'm not worried about the performance but mostly about the price. I only hope AMD delivers as well or otherwise we will have these cards for crapload of money. That would be a disaster.
 
Joined
Oct 17, 2014
Messages
4,095 (2.09/day)
Location
USA
Final Fantasy X Summoning!!! Ultima Bahamut with Yojimbo RTX cores!!!! :rockout:

I have a feeling these rumors are true, mainly cause they are afraid of Big Navi.

Glorious time for gamers! Rejoice brothers! Glory is here!
 
Joined
May 31, 2016
Messages
1,572 (1.15/day)
System Name Bro2
Processor Ryzen 2700X
Motherboard MSI X470 Gaming Carbon
Cooling Corsair h115i pro rgb
Memory G.Skill Flare X 3200 CL14
Video Card(s) RX Vega 64 Red Devil
Storage M.2 Samsung Evo 970 250MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD
Case Fractal Design G
Audio Device(s) realtec 5.1
Power Supply Corsair AXi 760W
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Final Fantasy X Summoning!!! Ultima Bahamut with Yojimbo RTX cores!!!! :rockout:

I have a feeling these rumors are true, mainly cause they are afraid of Big Navi.

Glorious time for gamers! Rejoice brothers! Glory is here!
Hope you are not mistaken. I like your charisma bro. I really hope the big navi will give some sort of stimulus to NV's RTX cards.
 
Last edited:
Joined
Aug 6, 2017
Messages
5,991 (6.40/day)
Location
Poland
System Name skurwiel szatan
Processor i7 5775c @4.3GHz/1.385v/EDRAM @2GHz
Motherboard Z97X Gaming 5
Cooling Noctua D15S
Memory Crucial Ballistix Tactical LP 1600 CL8 @2133 9-9-9-27 1T
Video Card(s) RTX 2070 Super Gaming X Trio (waiting for RX 5950XT)
Storage SU900 128 (OS)/850 PRO 256+256+ 512,860 EVO 500,XPG SX950U 480,M9Pe(Y) 512 (games)/4TB HDDs (3+1)
Display(s) Acer XB241YU+Dell S2716DG dual monitor setup
Case Full tower
Audio Device(s) W830BT headphones
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
I have a feeling these rumors are true, mainly cause they are afraid of Big Navi.
Just like they have been afraid of everything amd has done for five years that ultimately allowed them to sell their xx106 dies at $500
 
Last edited:
Joined
Feb 23, 2019
Messages
1,055 (2.86/day)
Location
Poland
Processor Ryzen 7 3700X
Motherboard Gigabyte X570 Aorus Elite
Cooling BeQuiet Dark Rock 4
Memory 2x8 GB Crucial Ballistix Sport LT 3200 CL16 @ 3466 CL 14
Video Card(s) EVGA 1060 6GB SSC
Storage SX8200 Pro 1 TB, Plextor M6Pro 256 GB, WD Blue 2TB
Display(s) BenQ BL2411PT
Case SilverStone Primera PM01 RGB
Power Supply SeaSonic Focus Plus Gold 750W
Mouse SteelSeries Rival 300
Keyboard MK Typist (Kailh Box White)
One thing's for sure, they'll cost more. At least in high end, since that's where AMD struggles to compete with Nvidia.
 
Joined
Jul 10, 2015
Messages
197 (0.12/day)
Location
Sokovia
System Name Alienation from family
Processor i7 7700k
Motherboard Hero VIII
Cooling Macho revB
Memory 16gb Hyperx
Video Card(s) Asus 1080ti Strix OC
Storage 960evo 500gb
Display(s) AOC 4k
Case Define R2 XL
Power Supply Be f*ing Quiet 600W M Gold
Mouse NoName
Keyboard NoNameless HP
Software You have nothing on me
Benchmark Scores Personal record 100m sprint: 60m
One thing's for sure, they'll cost more. At least in high end, since that's where AMD struggles to compete with Nvidia.
Turing will be discounted though. 2070super for 350eur, njami!
 
Joined
Aug 13, 2010
Messages
4,593 (1.32/day)
This new architecture might be incredibly fast, but i can't even begin to imagine the pricing on products...
 
Joined
Aug 6, 2017
Messages
5,991 (6.40/day)
Location
Poland
System Name skurwiel szatan
Processor i7 5775c @4.3GHz/1.385v/EDRAM @2GHz
Motherboard Z97X Gaming 5
Cooling Noctua D15S
Memory Crucial Ballistix Tactical LP 1600 CL8 @2133 9-9-9-27 1T
Video Card(s) RTX 2070 Super Gaming X Trio (waiting for RX 5950XT)
Storage SU900 128 (OS)/850 PRO 256+256+ 512,860 EVO 500,XPG SX950U 480,M9Pe(Y) 512 (games)/4TB HDDs (3+1)
Display(s) Acer XB241YU+Dell S2716DG dual monitor setup
Case Full tower
Audio Device(s) W830BT headphones
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
One thing's for sure, they'll cost more. At least in high end, since that's where AMD struggles to compete with Nvidia.
Yup.expect reasonably priced 9-10 tflop cards and big premiums on faster ones.
I dont think were getting 2080ti performance cheaper than $699
 

ppn

Joined
Aug 18, 2015
Messages
613 (0.37/day)
They need at least 8192 Cuda at 2.1Ghz 1:2 FP64 to do 17.2 Tflops and if we look at NAvi 7nm is only 60% denser that 12nm. So it is similarly sized as Volta but 2.6 faster.
 
Joined
Aug 12, 2019
Messages
227 (1.14/day)
System Name Custom
Processor i9 9900k
Motherboard Gigabyte Z390 arous master
Cooling corsair h150i
Memory 4x8 3200mhz corsair
Video Card(s) GTX 1070ti
Storage 500gb Samsung 970 Evo PLus
Display(s) 1080P
Case Lian Li Pc-011 Dynamic
Audio Device(s) onboard :(
Power Supply 850w Seasonic Focus Platinum
Mouse Logitech G403
i dont think nvidia is going to change the price on their top tier cards.
Lets say big navi comes out and the performance of it is better than the rtx 2080ti.
Nvidia will drop the price of the 2080ti to match the big navi price
then when the ampere card launches later on, nvidia will jack up the top tier card back to $999 saying its faster to justify the cost
 
Joined
Aug 6, 2017
Messages
5,991 (6.40/day)
Location
Poland
System Name skurwiel szatan
Processor i7 5775c @4.3GHz/1.385v/EDRAM @2GHz
Motherboard Z97X Gaming 5
Cooling Noctua D15S
Memory Crucial Ballistix Tactical LP 1600 CL8 @2133 9-9-9-27 1T
Video Card(s) RTX 2070 Super Gaming X Trio (waiting for RX 5950XT)
Storage SU900 128 (OS)/850 PRO 256+256+ 512,860 EVO 500,XPG SX950U 480,M9Pe(Y) 512 (games)/4TB HDDs (3+1)
Display(s) Acer XB241YU+Dell S2716DG dual monitor setup
Case Full tower
Audio Device(s) W830BT headphones
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
i dont think nvidia is going to change the price on their top tier cards.
Lets say big navi comes out and the performance of it is better than the rtx 2080ti.
Nvidia will drop the price of the 2080ti to match the big navi price
then when the ampere card launches later on, nvidia will jack up the top tier card back to $999 saying its faster to justify the cost
There will be no big navi.
They cant even get the small navi to work properly.
Ampere will compete with turing and next gen consoles (and their desktop equivalents).
 

ppn

Joined
Aug 18, 2015
Messages
613 (0.37/day)
EUV will be limited to 429 mm2. AMD card will draw twice the power. So that 429mm2 draws 429 watts, and in case of nvidia 215 watts for the same performance. So there you have it.
 
Joined
Jan 8, 2017
Messages
4,751 (4.15/day)
System Name Good enough
Processor AMD Ryzen R7 1700X - 4.0 Ghz / 1.350V
Motherboard ASRock B450M Pro4
Cooling Scythe Katana 4 - 3x 120mm case fans
Memory 16GB - Corsair Vengeance LPX
Video Card(s) OEM Dell GTX 1080
Storage 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) 4K Samsung TV
Case Zalman R1
Power Supply 500W
I have my doubts, if they maintain the 1:2 ratio it would take a chip close to the current 16nm reticle limit running in excess of 2.1 Ghz to achieve anywhere close to 18 TFLOPS. Not only that it would be incredibly expensive and probably have abysmal yields but the power will be insane. I just don't can't see them clocking a Tesla part that high, it's not feasible.

1:1 ratio is an option but it would come with massive die space cost which again, I don't see them doing it.

Something else is going on.
 
Joined
Jun 19, 2010
Messages
195 (0.06/day)
Location
North-Rhine-Westphalia
Processor Ryzen 2700
Motherboard B450
Cooling Thermalright ARO
Memory 2x 8GB DDR4-2133
Video Card(s) RX 570 8GB
Storage 256GB SSD
Display(s) UHD 40" HDR TV
Case Sharkoon AM5 Window red
Audio Device(s) USB Headset
Power Supply beQuiet PurePower10 400W
Software Win10
I think a doubling of the TPC in every GPC is likely, going from Turings 6 in the "big GPC" to 12. (Turing small GPC are 4 TPC)
So every "big GPC" will grow to 1536 Cores, so with 6 GPC we reach 9216 Cores.
At 1.9 GHz we reach 17.51 TFlops FP64.

Nvidia did the big(6 TPC) and small (4 TPC) GPC experiment the first time with Turing, i bet that was for a reason.
Turing was also the first time that a non-top-tier chip like the RTX 2080 got 6 GPC when the top-tier has also 6 GPC.
Going over 6 GPC would likely drive the chip complexity without any significant gains, but putting more horsepower in every GPC makes sense.
Maybe Ampere brings even more variance in TPC count per GPC.
12 TPC = 1536 Cores
10 TPC = 1280
_8 TPC = 1024
_6 TPC = _768

at 6 GPC that would bring 9216 or 7680 or 6144 or 4608 Cores (TU102)
 
Joined
May 31, 2016
Messages
1,572 (1.15/day)
System Name Bro2
Processor Ryzen 2700X
Motherboard MSI X470 Gaming Carbon
Cooling Corsair h115i pro rgb
Memory G.Skill Flare X 3200 CL14
Video Card(s) RX Vega 64 Red Devil
Storage M.2 Samsung Evo 970 250MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD
Case Fractal Design G
Audio Device(s) realtec 5.1
Power Supply Corsair AXi 760W
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
There will be no big navi.
They cant even get the small navi to work properly.
Ampere will compete with turing and next gen consoles (and their desktop equivalents).
I'm sure about High-end NAVI (RDNA) not coming but RDNA2 will hit the market this year. Lisa Su has already confirmed that the RDNA2 high-end graphics release in 2020 and CES will have a keynote about it and this will also have Ray tracing support. If this RDNA2 will compete with NV graphics is unknown but also we don't know much about new NV release. I read that the high-end RDNA2 will flood markets with outstanding 4k performance. If that is going to happen only time will tell.
 
Last edited:
Joined
Aug 6, 2017
Messages
5,991 (6.40/day)
Location
Poland
System Name skurwiel szatan
Processor i7 5775c @4.3GHz/1.385v/EDRAM @2GHz
Motherboard Z97X Gaming 5
Cooling Noctua D15S
Memory Crucial Ballistix Tactical LP 1600 CL8 @2133 9-9-9-27 1T
Video Card(s) RTX 2070 Super Gaming X Trio (waiting for RX 5950XT)
Storage SU900 128 (OS)/850 PRO 256+256+ 512,860 EVO 500,XPG SX950U 480,M9Pe(Y) 512 (games)/4TB HDDs (3+1)
Display(s) Acer XB241YU+Dell S2716DG dual monitor setup
Case Full tower
Audio Device(s) W830BT headphones
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
I read that the high-end RDNA2 will flood markets with outstanding 4k performance. If that is going to happen only time will tell.
Outstanding,flood - where did you get that?
Nvidia calls anything tu104 based their high end and AMD seems happy to follow so there is no useful information in what you cited.
 
Joined
May 31, 2016
Messages
1,572 (1.15/day)
System Name Bro2
Processor Ryzen 2700X
Motherboard MSI X470 Gaming Carbon
Cooling Corsair h115i pro rgb
Memory G.Skill Flare X 3200 CL14
Video Card(s) RX Vega 64 Red Devil
Storage M.2 Samsung Evo 970 250MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD
Case Fractal Design G
Audio Device(s) realtec 5.1
Power Supply Corsair AXi 760W
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Outstanding,flood - where did you get that?
Nvidia calls anything tu104 based their high end and AMD seems happy to follow so there is no useful information in what you cited.
flood the market meaning disrupting the GPU market.
As you read, "change the 4k gaming as ryzen did for CPUs", in my words outstanding. What other conclusion would you have in mind?
It's just how I get it. Will it be true? How could you or I tell?
 
Joined
Aug 6, 2017
Messages
5,991 (6.40/day)
Location
Poland
System Name skurwiel szatan
Processor i7 5775c @4.3GHz/1.385v/EDRAM @2GHz
Motherboard Z97X Gaming 5
Cooling Noctua D15S
Memory Crucial Ballistix Tactical LP 1600 CL8 @2133 9-9-9-27 1T
Video Card(s) RTX 2070 Super Gaming X Trio (waiting for RX 5950XT)
Storage SU900 128 (OS)/850 PRO 256+256+ 512,860 EVO 500,XPG SX950U 480,M9Pe(Y) 512 (games)/4TB HDDs (3+1)
Display(s) Acer XB241YU+Dell S2716DG dual monitor setup
Case Full tower
Audio Device(s) W830BT headphones
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
flood the market meaning disrupting the GPU market.
As you read, "change the 4k gaming as ryzen did for CPUs", in my words outstanding. What other conclusion would you have in mind?
It's just how I get it. Will it be true? How could you or I tell?
What is this gibberish?
Is there a card coming or not? How does it perform?
 
Joined
May 31, 2016
Messages
1,572 (1.15/day)
System Name Bro2
Processor Ryzen 2700X
Motherboard MSI X470 Gaming Carbon
Cooling Corsair h115i pro rgb
Memory G.Skill Flare X 3200 CL14
Video Card(s) RX Vega 64 Red Devil
Storage M.2 Samsung Evo 970 250MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD
Case Fractal Design G
Audio Device(s) realtec 5.1
Power Supply Corsair AXi 760W
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
What is this gibberish?
Is there a card coming or not? How does it perform?
Is there a card coming? Yes
How will it perform? Hasn't been revealed yet. CES 2020 hold your horses.
 
Joined
Aug 6, 2017
Messages
5,991 (6.40/day)
Location
Poland
System Name skurwiel szatan
Processor i7 5775c @4.3GHz/1.385v/EDRAM @2GHz
Motherboard Z97X Gaming 5
Cooling Noctua D15S
Memory Crucial Ballistix Tactical LP 1600 CL8 @2133 9-9-9-27 1T
Video Card(s) RTX 2070 Super Gaming X Trio (waiting for RX 5950XT)
Storage SU900 128 (OS)/850 PRO 256+256+ 512,860 EVO 500,XPG SX950U 480,M9Pe(Y) 512 (games)/4TB HDDs (3+1)
Display(s) Acer XB241YU+Dell S2716DG dual monitor setup
Case Full tower
Audio Device(s) W830BT headphones
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
Is there a card coming? Yes
How will it perform? Hasn't been revealed yet. CES 2020 hold your horses.
When is the card coming ? Q1 or Q4?
 
Joined
May 31, 2016
Messages
1,572 (1.15/day)
System Name Bro2
Processor Ryzen 2700X
Motherboard MSI X470 Gaming Carbon
Cooling Corsair h115i pro rgb
Memory G.Skill Flare X 3200 CL14
Video Card(s) RX Vega 64 Red Devil
Storage M.2 Samsung Evo 970 250MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD
Case Fractal Design G
Audio Device(s) realtec 5.1
Power Supply Corsair AXi 760W
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Joined
Mar 23, 2005
Messages
3,571 (0.65/day)
Location
Ancient Greece, Acropolis (Time Lord)
System Name RiseEN Gaming PC
Processor AMD Ryzen 7 1700X @ stock
Motherboard ASRock Fatal1ty X370 GAMING X AM4
Cooling Corsair H115i PRO RGB, 280mm Radiator, Dual 140mm ML Series PWM Fans
Memory G.Skill TridentZ 32GB (2 x 16GB) DDR4 3200
Video Card(s) Sapphire Radeon RX 580 8GB Nitro+ SE
Storage Corsair Force MP500 480GB M.2 (OS) + Force MP510 480GB M.2 (Steam/Games)
Display(s) Asus 27" (MG278Q) 144Hz WQHD 1440p + 1 x Asus 24" (VG245H) FHD 75Hz 1080p
Case Corsair Obsidian Series 450D Gaming Case
Audio Device(s) SteelSeries 5Hv2 w/ ASUS Xonar DGX PCI-E GX2.5 Audio Engine Sound Card
Power Supply Corsair TX750W Power Supply
Mouse Razer DeathAdder PC Gaming Mouse - Ergonomic Left Hand Edition
Keyboard Logitech G15 Classic Gaming Keyboard
Software Windows 10 Pro - 64-Bit Edition
Benchmark Scores I'm the Doctor.
Turing will be discounted though. 2070super for 350eur, njami!
Still overpriced lol

A cute little Cardinal birdie told me that Nvidia will not release Ampere until AMD releases RDNA2. And another cute little birdie, this time the birdie was a Blue Jay told me AMD won't release RDNA2 until Nvidia releases Ampere.

Which cute little birdie will you believe?

When is the card coming ? Q1 or Q4?
Q1 Launch Ampere Server GPUs.
Q2 Release Ampere Server GPUs & Launch Ampere Desktop GPUs.
Q3-Q4 Release Ampere Desktop GPUs.
Or listen to the birdies.
 
Top