• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA's Next-Generation "Ampere" GPUs Could Have 18 TeraFLOPs of Compute Performance

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,190 (0.91/day)
NVIDIA will soon launch its next-generation lineup of graphics cards based on a new and improved "Ampere" architecture. With the first Tesla server cards that are a part of the Ampere lineup going inside Indiana University Big Red 200 supercomputer, we now have some potential specifications and information about its compute performance. Thanks to the Twitter user dylan552p(@dylan522p), who did some math about the potential compute performance of the Ampere GPUs based on NextPlatform's report, we discovered that Ampere is potentially going to feature up to 18 TeraFLOPs of FP64 compute performance.

With Big Red 200 supercomputer being based on Cray's Shasta supercomputer building block, it is being deployed in two phases. The first phase is the deployment of 672 dual-socket nodes powered by AMD's EPYC 7742 "Rome" processors. These CPUs provide 3.15 PetaFLOPs of combined FP64 performance. With a total of 8 PetaFLOPs planned to be achieved by the Big Red 200, that leaves just a bit under 5 PetaFLOPs to be had using GPU+CPU enabled system. Considering the configuration of a node that contains one next-generation AMD "Milan" 64 core CPU, and four of NVIDIA's "Ampere" GPUs alongside it. If we take for a fact that Milan boosts FP64 performance by 25% compared to Rome, then the math shows that the 256 GPUs that will be delivered in the second phase of Big Red 200 deployment will feature up to 18 TeraFLOPs of FP64 compute performance. Even if "Milan" doubles the FP64 compute power of "Rome", there will be around 17.6 TeraFLOPs of FP64 performance for the GPU.


View at TechPowerUp Main Site
 
Joined
May 31, 2016
Messages
4,323 (1.51/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
With NV I'm not worried about the performance but mostly about the price. I only hope AMD delivers as well or otherwise we will have these cards for crapload of money. That would be a disaster.
 

Space Lynx

Astronaut
Joined
Oct 17, 2014
Messages
15,800 (4.58/day)
Location
Kepler-186f
Final Fantasy X Summoning!!! Ultima Bahamut with Yojimbo RTX cores!!!! :rockout:

I have a feeling these rumors are true, mainly cause they are afraid of Big Navi.

Glorious time for gamers! Rejoice brothers! Glory is here!
 
Joined
May 31, 2016
Messages
4,323 (1.51/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Final Fantasy X Summoning!!! Ultima Bahamut with Yojimbo RTX cores!!!! :rockout:

I have a feeling these rumors are true, mainly cause they are afraid of Big Navi.

Glorious time for gamers! Rejoice brothers! Glory is here!
Hope you are not mistaken. I like your charisma bro. I really hope the big navi will give some sort of stimulus to NV's RTX cards.
 
Last edited:
Joined
Aug 6, 2017
Messages
7,412 (3.05/day)
Location
Poland
System Name Purple rain
Processor 10.5 thousand 4.2G 1.1v
Motherboard Zee 490 Aorus Elite
Cooling Noctua D15S
Memory 16GB 4133 CL16-16-16-31 Viper Steel
Video Card(s) RTX 2070 Super Gaming X Trio
Storage SU900 128,8200Pro 1TB,850 Pro 512+256+256,860 Evo 500,XPG950 480, Skyhawk 2TB
Display(s) Acer XB241YU+Dell S2716DG
Case P600S Silent w. Alpenfohn wing boost 3 ARGBT+ fans
Audio Device(s) K612 Pro w. FiiO E10k DAC,W830BT wireless
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
I have a feeling these rumors are true, mainly cause they are afraid of Big Navi.
Just like they have been afraid of everything amd has done for five years that ultimately allowed them to sell their xx106 dies at $500
 
Last edited:
Joined
Feb 23, 2019
Messages
5,581 (3.00/day)
Location
Poland
Processor Ryzen 7 5800X3D
Motherboard Gigabyte X570 Aorus Elite
Cooling Thermalright Phantom Spirit 120 SE
Memory 2x16 GB Crucial Ballistix 3600 CL16 Rev E @ 3800 CL16
Video Card(s) RTX3080 Ti FE
Storage SX8200 Pro 1 TB, Plextor M6Pro 256 GB, WD Blue 2TB
Display(s) LG 34GN850P-B
Case SilverStone Primera PM01 RGB
Audio Device(s) SoundBlaster G6 | Fidelio X2 | Sennheiser 6XX
Power Supply SeaSonic Focus Plus Gold 750W
Mouse Endgame Gear XM1R
Keyboard Wooting Two HE
One thing's for sure, they'll cost more. At least in high end, since that's where AMD struggles to compete with Nvidia.
 
Joined
Jul 10, 2015
Messages
748 (0.23/day)
Location
Sokovia
System Name Alienation from family
Processor i7 7700k
Motherboard Hero VIII
Cooling Macho revB
Memory 16gb Hyperx
Video Card(s) Asus 1080ti Strix OC
Storage 960evo 500gb
Display(s) AOC 4k
Case Define R2 XL
Power Supply Be f*ing Quiet 600W M Gold
Mouse NoName
Keyboard NoNameless HP
Software You have nothing on me
Benchmark Scores Personal record 100m sprint: 60m
One thing's for sure, they'll cost more. At least in high end, since that's where AMD struggles to compete with Nvidia.
Turing will be discounted though. 2070super for 350eur, njami!
 
Joined
Aug 13, 2010
Messages
5,380 (1.08/day)
This new architecture might be incredibly fast, but i can't even begin to imagine the pricing on products...
 
Joined
Aug 6, 2017
Messages
7,412 (3.05/day)
Location
Poland
System Name Purple rain
Processor 10.5 thousand 4.2G 1.1v
Motherboard Zee 490 Aorus Elite
Cooling Noctua D15S
Memory 16GB 4133 CL16-16-16-31 Viper Steel
Video Card(s) RTX 2070 Super Gaming X Trio
Storage SU900 128,8200Pro 1TB,850 Pro 512+256+256,860 Evo 500,XPG950 480, Skyhawk 2TB
Display(s) Acer XB241YU+Dell S2716DG
Case P600S Silent w. Alpenfohn wing boost 3 ARGBT+ fans
Audio Device(s) K612 Pro w. FiiO E10k DAC,W830BT wireless
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
One thing's for sure, they'll cost more. At least in high end, since that's where AMD struggles to compete with Nvidia.
Yup.expect reasonably priced 9-10 tflop cards and big premiums on faster ones.
I dont think were getting 2080ti performance cheaper than $699
 

ppn

Joined
Aug 18, 2015
Messages
1,231 (0.39/day)
They need at least 8192 Cuda at 2.1Ghz 1:2 FP64 to do 17.2 Tflops and if we look at NAvi 7nm is only 60% denser that 12nm. So it is similarly sized as Volta but 2.6 faster.
 
Joined
Aug 12, 2019
Messages
1,690 (1.00/day)
Location
LV-426
System Name Custom
Processor i9 9900k
Motherboard Gigabyte Z390 arous master
Cooling corsair h150i
Memory 4x8 3200mhz corsair
Video Card(s) Galax RTX 3090 EX Gamer White OC
Storage 500gb Samsung 970 Evo PLus
Display(s) MSi MAG341CQ
Case Lian Li Pc-011 Dynamic
Audio Device(s) Arctis Pro Wireless
Power Supply 850w Seasonic Focus Platinum
Mouse Logitech G403
Keyboard Logitech G110
i dont think nvidia is going to change the price on their top tier cards.
Lets say big navi comes out and the performance of it is better than the rtx 2080ti.
Nvidia will drop the price of the 2080ti to match the big navi price
then when the ampere card launches later on, nvidia will jack up the top tier card back to $999 saying its faster to justify the cost
 
Joined
Aug 6, 2017
Messages
7,412 (3.05/day)
Location
Poland
System Name Purple rain
Processor 10.5 thousand 4.2G 1.1v
Motherboard Zee 490 Aorus Elite
Cooling Noctua D15S
Memory 16GB 4133 CL16-16-16-31 Viper Steel
Video Card(s) RTX 2070 Super Gaming X Trio
Storage SU900 128,8200Pro 1TB,850 Pro 512+256+256,860 Evo 500,XPG950 480, Skyhawk 2TB
Display(s) Acer XB241YU+Dell S2716DG
Case P600S Silent w. Alpenfohn wing boost 3 ARGBT+ fans
Audio Device(s) K612 Pro w. FiiO E10k DAC,W830BT wireless
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
i dont think nvidia is going to change the price on their top tier cards.
Lets say big navi comes out and the performance of it is better than the rtx 2080ti.
Nvidia will drop the price of the 2080ti to match the big navi price
then when the ampere card launches later on, nvidia will jack up the top tier card back to $999 saying its faster to justify the cost
There will be no big navi.
They cant even get the small navi to work properly.
Ampere will compete with turing and next gen consoles (and their desktop equivalents).
 

ppn

Joined
Aug 18, 2015
Messages
1,231 (0.39/day)
EUV will be limited to 429 mm2. AMD card will draw twice the power. So that 429mm2 draws 429 watts, and in case of nvidia 215 watts for the same performance. So there you have it.
 
Joined
Jan 8, 2017
Messages
8,863 (3.36/day)
System Name Good enough
Processor AMD Ryzen R9 7900 - Alphacool Eisblock XPX Aurora Edge
Motherboard ASRock B650 Pro RS
Cooling 2x 360mm NexXxoS ST30 X-Flow, 1x 360mm NexXxoS ST30, 1x 240mm NexXxoS ST30
Memory 32GB - FURY Beast RGB 5600 Mhz
Video Card(s) Sapphire RX 7900 XT - Alphacool Eisblock Aurora
Storage 1x Kingston KC3000 1TB 1x Kingston A2000 1TB, 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) LG UltraGear 32GN650-B + 4K Samsung TV
Case Phanteks NV7
Power Supply GPS-750C
I have my doubts, if they maintain the 1:2 ratio it would take a chip close to the current 16nm reticle limit running in excess of 2.1 Ghz to achieve anywhere close to 18 TFLOPS. Not only that it would be incredibly expensive and probably have abysmal yields but the power will be insane. I just don't can't see them clocking a Tesla part that high, it's not feasible.

1:1 ratio is an option but it would come with massive die space cost which again, I don't see them doing it.

Something else is going on.
 
Joined
Jun 19, 2010
Messages
397 (0.08/day)
Location
Germany (Euregio)
Processor Ryzen 5600X
Video Card(s) RTX 3050
Software Win11
I think a doubling of the TPC in every GPC is likely, going from Turings 6 in the "big GPC" to 12. (Turing small GPC are 4 TPC)
So every "big GPC" will grow to 1536 Cores, so with 6 GPC we reach 9216 Cores.
At 1.9 GHz we reach 17.51 TFlops FP64.

Nvidia did the big(6 TPC) and small (4 TPC) GPC experiment the first time with Turing, i bet that was for a reason.
Turing was also the first time that a non-top-tier chip like the RTX 2080 got 6 GPC when the top-tier has also 6 GPC.
Going over 6 GPC would likely drive the chip complexity without any significant gains, but putting more horsepower in every GPC makes sense.
Maybe Ampere brings even more variance in TPC count per GPC.
12 TPC = 1536 Cores
10 TPC = 1280
_8 TPC = 1024
_6 TPC = _768

at 6 GPC that would bring 9216 or 7680 or 6144 or 4608 Cores (TU102)
 
Joined
May 31, 2016
Messages
4,323 (1.51/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
There will be no big navi.
They cant even get the small navi to work properly.
Ampere will compete with turing and next gen consoles (and their desktop equivalents).
I'm sure about High-end NAVI (RDNA) not coming but RDNA2 will hit the market this year. Lisa Su has already confirmed that the RDNA2 high-end graphics release in 2020 and CES will have a keynote about it and this will also have Ray tracing support. If this RDNA2 will compete with NV graphics is unknown but also we don't know much about new NV release. I read that the high-end RDNA2 will flood markets with outstanding 4k performance. If that is going to happen only time will tell.
 
Last edited:
Joined
Nov 6, 2016
Messages
1,561 (0.58/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10
Joined
Aug 6, 2017
Messages
7,412 (3.05/day)
Location
Poland
System Name Purple rain
Processor 10.5 thousand 4.2G 1.1v
Motherboard Zee 490 Aorus Elite
Cooling Noctua D15S
Memory 16GB 4133 CL16-16-16-31 Viper Steel
Video Card(s) RTX 2070 Super Gaming X Trio
Storage SU900 128,8200Pro 1TB,850 Pro 512+256+256,860 Evo 500,XPG950 480, Skyhawk 2TB
Display(s) Acer XB241YU+Dell S2716DG
Case P600S Silent w. Alpenfohn wing boost 3 ARGBT+ fans
Audio Device(s) K612 Pro w. FiiO E10k DAC,W830BT wireless
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
I read that the high-end RDNA2 will flood markets with outstanding 4k performance. If that is going to happen only time will tell.
Outstanding,flood - where did you get that?
Nvidia calls anything tu104 based their high end and AMD seems happy to follow so there is no useful information in what you cited.
 
Joined
May 31, 2016
Messages
4,323 (1.51/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Outstanding,flood - where did you get that?
Nvidia calls anything tu104 based their high end and AMD seems happy to follow so there is no useful information in what you cited.
flood the market meaning disrupting the GPU market.
As you read, "change the 4k gaming as ryzen did for CPUs", in my words outstanding. What other conclusion would you have in mind?
It's just how I get it. Will it be true? How could you or I tell?
 
Joined
Aug 6, 2017
Messages
7,412 (3.05/day)
Location
Poland
System Name Purple rain
Processor 10.5 thousand 4.2G 1.1v
Motherboard Zee 490 Aorus Elite
Cooling Noctua D15S
Memory 16GB 4133 CL16-16-16-31 Viper Steel
Video Card(s) RTX 2070 Super Gaming X Trio
Storage SU900 128,8200Pro 1TB,850 Pro 512+256+256,860 Evo 500,XPG950 480, Skyhawk 2TB
Display(s) Acer XB241YU+Dell S2716DG
Case P600S Silent w. Alpenfohn wing boost 3 ARGBT+ fans
Audio Device(s) K612 Pro w. FiiO E10k DAC,W830BT wireless
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
flood the market meaning disrupting the GPU market.
As you read, "change the 4k gaming as ryzen did for CPUs", in my words outstanding. What other conclusion would you have in mind?
It's just how I get it. Will it be true? How could you or I tell?
What is this gibberish?
Is there a card coming or not? How does it perform?
 
Joined
May 31, 2016
Messages
4,323 (1.51/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
What is this gibberish?
Is there a card coming or not? How does it perform?
Is there a card coming? Yes
How will it perform? Hasn't been revealed yet. CES 2020 hold your horses.
 
Joined
Aug 6, 2017
Messages
7,412 (3.05/day)
Location
Poland
System Name Purple rain
Processor 10.5 thousand 4.2G 1.1v
Motherboard Zee 490 Aorus Elite
Cooling Noctua D15S
Memory 16GB 4133 CL16-16-16-31 Viper Steel
Video Card(s) RTX 2070 Super Gaming X Trio
Storage SU900 128,8200Pro 1TB,850 Pro 512+256+256,860 Evo 500,XPG950 480, Skyhawk 2TB
Display(s) Acer XB241YU+Dell S2716DG
Case P600S Silent w. Alpenfohn wing boost 3 ARGBT+ fans
Audio Device(s) K612 Pro w. FiiO E10k DAC,W830BT wireless
Power Supply Superflower Leadex Gold 850W
Mouse G903 lightspeed+powerplay,G403 wireless + Steelseries DeX + Roccat rest
Keyboard HyperX Alloy SilverSpeed (w.HyperX wrist rest),Razer Deathstalker
Software Windows 10
Benchmark Scores A LOT
Is there a card coming? Yes
How will it perform? Hasn't been revealed yet. CES 2020 hold your horses.
When is the card coming ? Q1 or Q4?
 
Joined
May 31, 2016
Messages
4,323 (1.51/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Joined
Mar 23, 2005
Messages
4,054 (0.58/day)
Location
Ancient Greece, Acropolis (Time Lord)
System Name RiseZEN Gaming PC
Processor AMD Ryzen 7 5800X @ Auto
Motherboard Asus ROG Strix X570-E Gaming ATX Motherboard
Cooling Corsair H115i Elite Capellix AIO, 280mm Radiator, Dual RGB 140mm ML Series PWM Fans
Memory G.Skill TridentZ 64GB (4 x 16GB) DDR4 3200
Video Card(s) ASUS DUAL RX 6700 XT DUAL-RX6700XT-12G
Storage Corsair Force MP500 480GB M.2 & MP510 480GB M.2 - 2 x WD_BLACK 1TB SN850X NVMe 1TB
Display(s) ASUS ROG Strix 34” XG349C 180Hz 1440p + Asus ROG 27" MG278Q 144Hz WQHD 1440p
Case Corsair Obsidian Series 450D Gaming Case
Audio Device(s) SteelSeries 5Hv2 w/ Sound Blaster Z SE
Power Supply Corsair RM750x Power Supply
Mouse Razer Death-Adder + Viper 8K HZ Ambidextrous Gaming Mouse - Ergonomic Left Hand Edition
Keyboard Logitech G910 Orion Spectrum RGB Gaming Keyboard
Software Windows 11 Pro - 64-Bit Edition
Benchmark Scores I'm the Doctor, Doctor Who. The Definition of Gaming is PC Gaming...
Turing will be discounted though. 2070super for 350eur, njami!
Still overpriced lol

A cute little Cardinal birdie told me that Nvidia will not release Ampere until AMD releases RDNA2. And another cute little birdie, this time the birdie was a Blue Jay told me AMD won't release RDNA2 until Nvidia releases Ampere.

Which cute little birdie will you believe?

When is the card coming ? Q1 or Q4?
Q1 Launch Ampere Server GPUs.
Q2 Release Ampere Server GPUs & Launch Ampere Desktop GPUs.
Q3-Q4 Release Ampere Desktop GPUs.
Or listen to the birdies.
 
Top