• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Volta to bring 1 TB/s memory bandwidth to GPUs?

cadaveca

My name is Dave
Joined
Apr 10, 2006
Messages
17,232 (2.62/day)
Nvidia's GTC is on now.

volta.jpg



More here:

http://www.ustream.tv/recorded/30095793
 
Joined
Jan 14, 2009
Messages
2,644 (0.47/day)
Location
...
System Name MRCOMP!
Processor 5800X3D
Motherboard MSI Gaming Plus
Cooling Corsair 280 AIO
Memory 64GB 3600mhz
Video Card(s) GTX3060
Storage 1TB SSD
Display(s) Samsung Neo
Case No Case... just sitting on cardboard :D
Power Supply Antec 650w
That robot in the intro is scary awesome!
 
Joined
Dec 16, 2010
Messages
1,662 (0.34/day)
Location
State College, PA, US
System Name My Surround PC
Processor AMD Ryzen 9 7950X3D
Motherboard ASUS STRIX X670E-F
Cooling Swiftech MCP35X / EK Quantum CPU / Alphacool GPU / XSPC 480mm w/ Corsair Fans
Memory 96GB (2 x 48 GB) G.Skill DDR5-6000 CL30
Video Card(s) MSI NVIDIA GeForce RTX 4090 Suprim X 24GB
Storage WD SN850 2TB, 2 x 512GB Samsung PM981a, 4 x 4TB HGST NAS HDD for Windows Storage Spaces
Display(s) 2 x Viotek GFI27QXA 27" 4K 120Hz + LG UH850 4K 60Hz + HMD
Case NZXT Source 530
Audio Device(s) Sony MDR-7506 / Logitech Z-5500 5.1
Power Supply Corsair RM1000x 1 kW
Mouse Patriot Viper V560
Keyboard Corsair K100
VR HMD HP Reverb G2
Software Windows 11 Pro x64
Benchmark Scores Mellanox ConnectX-3 10 Gb/s Fiber Network Card
1TB/sec sounds great, but that's ~4x the bandwidth of current high end GPUs. If bandwidth doubles each generation and Volta is two generations away, then it's normal progress.
 

MxPhenom 216

ASIC Engineer
Joined
Aug 31, 2010
Messages
12,945 (2.60/day)
Location
Loveland, CO
System Name Ryzen Reflection
Processor AMD Ryzen 9 5900x
Motherboard Gigabyte X570S Aorus Master
Cooling 2x EK PE360 | TechN AM4 AMD Block Black | EK Quantum Vector Trinity GPU Nickel + Plexi
Memory Teamgroup T-Force Xtreem 2x16GB B-Die 3600 @ 14-14-14-28-42-288-2T 1.45v
Video Card(s) Zotac AMP HoloBlack RTX 3080Ti 12G | 950mV 1950Mhz
Storage WD SN850 500GB (OS) | Samsung 980 Pro 1TB (Games_1) | Samsung 970 Evo 1TB (Games_2)
Display(s) Asus XG27AQM 240Hz G-Sync Fast-IPS | Gigabyte M27Q-P 165Hz 1440P IPS | Asus 24" IPS (portrait mode)
Case Lian Li PC-011D XL | Custom cables by Cablemodz
Audio Device(s) FiiO K7 | Sennheiser HD650 + Beyerdynamic FOX Mic
Power Supply Seasonic Prime Ultra Platinum 850
Mouse Razer Viper v2 Pro
Keyboard Razer Huntsman Tournament Edition
Software Windows 11 Pro 64-Bit
So Volta is their codename for the generation after Maxwell? Interesting...
 
Joined
Jan 2, 2012
Messages
1,079 (0.24/day)
Location
Indonesia
Processor AMD Ryzen 7 5700X
Motherboard ASUS STRIX X570-E
Cooling NOCTUA NH-U12A
Memory G.Skill FlareX 32 GB (4 x 8 GB) DDR4-3200
Video Card(s) ASUS RTX 4070 DUAL
Storage 1 TB WD Black SN850X | 2 TB WD Blue SN570 | 10 TB WD Purple Pro
Display(s) LG 32QP880N 32"
Case Fractal Design Define R5 Black
Power Supply Seasonic Focus Gold 750W
Mouse Pulsar X2
Keyboard KIRA EXS
Joined
Apr 30, 2012
Messages
3,881 (0.89/day)
Nvidia's GTC is on now.

The keynote was 12hrs ago. :slap:

Nothing too exciting just a bunch of graphs and the funniest part was when they were introducing the director for upcoming Fantastic Four and how GRID would help out. The crowd just didnt seam interested and JJ-H was try'n to get them interested. Even the director was like eh..

And not one mention of Project Shield just a reference to it when hes showing off Ira which had the responses scripted since you can tell it resets for each responce on the video.
 

cadaveca

My name is Dave
Joined
Apr 10, 2006
Messages
17,232 (2.62/day)
Tegra roadmap:


tegra roadmap.jpg



The keynote was 12hrs ago. :slap:

I had school today, so missed this, some interesting stuff but at the same time seemed like too much pandering. Will be interesting to hear some of the other presentations that'll be given over the next few days, so yeah, GTC is still ongoing. :p Maybe more interesting stuff will come in the next few days.
 
Joined
Aug 16, 2004
Messages
3,275 (0.46/day)
Location
Sunny California
Processor Intel Core i9 13900KF
Motherboard Asus ROG Maximus Z690 Hero EVA Edition
Cooling Asus Ryujin II 360 EVA Edition
Memory 4x16GBs DDR5 6800MHz G.Skill Trident Z5 Neo Series
Video Card(s) Zotac RTX 4090 AMP Extreme Airo
Storage 2TB Samsung 980 Pro OS - 4TB Nextorage G Series Games - 8TBs WD Black Storage
Display(s) LG C2 OLED 42" 4K 120Hz HDR G-Sync enabled TV
Case Asus ROG Helios EVA Edition
Audio Device(s) Denon AVR-S910W - 7.1 Klipsch Dolby ATMOS Speaker Setup - Audeze Maxwell
Power Supply EVGA Supernova G2 1300W
Mouse Asus ROG Keris EVA Edition - Asus ROG Scabbard II EVA Edition
Keyboard Asus ROG Strix Scope EVA Edition
VR HMD Samsung Odyssey VR
Software Windows 11 Pro 64bit
I know the technology is completely different, but I remember Nvidia embedding the VRAM to the RSX GPU substrate for PS3 back in 2006, I think it didn't offer much of a performance advantage back then due to the 128bit bus.

Embedding some sort of cache in the same substrate as the GPU die and giving it a 1024bit direct bus to the GPU could provide the necessary increase in bandwidth.

Since all the traces between the GPU and this cache memory would be relatively short and not an actual part of the PCB design, this approach would be feasible from an economic point of view.

I bet cards would still require more VRAM on the PCB with a more conventional bus in order to reduce design complexity and cost, and allow for more memory availability due to VRAM density not being limited by packaging constrains.
 
Last edited:

MxPhenom 216

ASIC Engineer
Joined
Aug 31, 2010
Messages
12,945 (2.60/day)
Location
Loveland, CO
System Name Ryzen Reflection
Processor AMD Ryzen 9 5900x
Motherboard Gigabyte X570S Aorus Master
Cooling 2x EK PE360 | TechN AM4 AMD Block Black | EK Quantum Vector Trinity GPU Nickel + Plexi
Memory Teamgroup T-Force Xtreem 2x16GB B-Die 3600 @ 14-14-14-28-42-288-2T 1.45v
Video Card(s) Zotac AMP HoloBlack RTX 3080Ti 12G | 950mV 1950Mhz
Storage WD SN850 500GB (OS) | Samsung 980 Pro 1TB (Games_1) | Samsung 970 Evo 1TB (Games_2)
Display(s) Asus XG27AQM 240Hz G-Sync Fast-IPS | Gigabyte M27Q-P 165Hz 1440P IPS | Asus 24" IPS (portrait mode)
Case Lian Li PC-011D XL | Custom cables by Cablemodz
Audio Device(s) FiiO K7 | Sennheiser HD650 + Beyerdynamic FOX Mic
Power Supply Seasonic Prime Ultra Platinum 850
Mouse Razer Viper v2 Pro
Keyboard Razer Huntsman Tournament Edition
Software Windows 11 Pro 64-Bit
Here is what I have to say to Nvidia now after watching a lot of the videos from today.

 
Joined
Apr 30, 2012
Messages
3,881 (0.89/day)

Thats another thing that felt flat.

Tegra roadmap needs to be push 2yrs forward to be competative.

Logan should have been what Tegra 4 "Wayne" Tegra4i "Grey" is. Thats why Qualcomm S600 is stealing all the flagship this year. Not one new phone that has been anounced will be using Tegra4i on there flagship product. The only one commited to carring Tegra4i is ZTE.

Parker is going to be a year or more late as thing stand. Dell has been testing AppliedMicro 64bit ARM since late last year and AMD will be producing a hybrid by 2014. By the time Parker rolls out 2nd gen 64bit ARM SoCs will be coming out.
 
Joined
Apr 4, 2008
Messages
4,686 (0.80/day)
System Name Obelisc
Processor i7 3770k @ 4.8 GHz
Motherboard Asus P8Z77-V
Cooling H110
Memory 16GB(4x4) @ 2400 MHz 9-11-11-31
Video Card(s) GTX 780 Ti
Storage 850 EVO 1TB, 2x 5TB Toshiba
Case T81
Audio Device(s) X-Fi Titanium HD
Power Supply EVGA 850 T2 80+ TITANIUM
Software Win10 64bit
1TB/sec sounds great, but that's ~4x the bandwidth of current high end GPUs. If bandwidth doubles each generation and Volta is two generations away, then it's normal progress.

Bandwidth doesn't double with each generation. They've been slacking with bandwidth improvements for awhile now. It's been a pretty slow craw from 100 to 200 GB/s.
 
Joined
Oct 2, 2004
Messages
13,791 (1.93/day)
The question here is, is memory bandwidth really that important? My answer is that GPU clock, throughput, shading perfomance and everything around it is far more important than high raw memory bandwidth.
 
Joined
Jun 27, 2011
Messages
6,684 (1.43/day)
Processor 7800x3d
Motherboard Gigabyte B650 Auros Elite AX
Cooling Custom Water
Memory GSKILL 2x16gb 6000mhz Cas 30 with custom timings
Video Card(s) MSI RX 6750 XT MECH 2X 12G OC
Storage Adata SX8200 1tb with Windows, Samsung 990 Pro 2tb with games
Display(s) HP Omen 27q QHD 165hz
Case ThermalTake P3
Power Supply SuperFlower Leadex Titanium
Software Windows 11 64 Bit
Benchmark Scores CB23: 1811 / 19424 CB24: 1136 / 7687
The question here is, is memory bandwidth really that important? My answer is that GPU clock, throughput, shading perfomance and everything around it is far more important than high raw memory bandwidth.

That is what I was wondering. Its a terabyte a second of bandwidth... At the very least it will make memory not a bottleneck for a while.
 
Joined
Sep 7, 2011
Messages
2,785 (0.60/day)
Location
New Zealand
System Name MoneySink
Processor 2600K @ 4.8
Motherboard P8Z77-V
Cooling AC NexXxos XT45 360, RayStorm, D5T+XSPC tank, Tygon R-3603, Bitspower
Memory 16GB Crucial Ballistix DDR3-1600C8
Video Card(s) GTX 780 SLI (EVGA SC ACX + Giga GHz Ed.)
Storage Kingston HyperX SSD (128) OS, WD RE4 (1TB), RE2 (1TB), Cav. Black (2 x 500GB), Red (4TB)
Display(s) Achieva Shimian QH270-IPSMS (2560x1440) S-IPS
Case NZXT Switch 810
Audio Device(s) onboard Realtek yawn edition
Power Supply Seasonic X-1050
Software Win8.1 Pro
Benchmark Scores 3.5 litres of Pale Ale in 18 minutes.
Joined
Apr 30, 2012
Messages
3,881 (0.89/day)
Those have already shown up in recent drivers

NVIDIA_DEV.0FC4 = "NVIDIA D14P1-15"
NVIDIA_DEV.0FC5 = "NVIDIA D15M2-03"
NVIDIA_DEV.0FDA = "NVIDIA GK107-ES-A1"
NVIDIA_DEV.0FE3 = "NVIDIA GeForce GT 745M"
NVIDIA_DEV.0FE5 = "NVIDIA GeForce K340 USM"
NVIDIA_DEV.0FE6 = "NVIDIA NVS K1 USM"
NVIDIA_DEV.0FE7 = "NVIDIA Generic K1 USM"
NVIDIA_DEV.0FEF = "NVIDIA GRID K340"
NVIDIA_DEV.0FF0 = "NVIDIA NB1Q"
NVIDIA_DEV.0FF1 = "NVIDIA NVS 1000"
NVIDIA_DEV.0FF2 = "NVIDIA GRID K1"
NVIDIA_DEV.0FF5 = "NVIDIA Tesla K1 USM"
NVIDIA_DEV.0FF7 = "NVIDIA Quadro K1 USM"
NVIDIA_DEV.1001 = "NVIDIA D15U-60"
NVIDIA_DEV.1003 = "NVIDIA GK110 DT Bringup"
NVIDIA_DEV.1004 = "NVIDIA D15U-50"
NVIDIA_DEV.1182 = "NVIDIA GK104"
NVIDIA_DEV.1184 = "NVIDIA GK104 "
NVIDIA_DEV.118A = "NVIDIA GRID K520"
NVIDIA_DEV.118B = "NVIDIA GeForce K2 USM"
NVIDIA_DEV.118C = "NVIDIA NVS K2 USM"
NVIDIA_DEV.118D = "NVIDIA Generic K2 USM"
NVIDIA_DEV.1192 = "NVIDIA GeForce GK104"
NVIDIA_DEV.119F = "NVIDIA GeForce GTX 780M"
NVIDIA_DEV.11D1 = "NVIDIA GK106-INT343"
NVIDIA_DEV.11D2 = "NVIDIA GK106-INT232"
NVIDIA_DEV.11D3 = "NVIDIA GK106-ES"
NVIDIA_DEV.11E2 = "NVIDIA GeForce GTX 765M"
NVIDIA_DEV.11E3 = "NVIDIA GeForce GTX 760M"
NVIDIA_DEV.11FF = "NVIDIA NB1Q "
NVIDIA_DEV.11B0 = "NVIDIA Quadro K2 USM"
NVIDIA_DEV.11B1 = "NVIDIA Tesla K2 USM"
NVIDIA_DEV.11B6 = "NVIDIA N15E-Q1"
NVIDIA_DEV.11B7 = "NVIDIA N15E-Q3"
NVIDIA_DEV.11B8 = "NVIDIA N15E-Q5"
NVIDIA_DEV.11BB = "NVIDIA Quadro 4100"
NVIDIA_DEV.11C1 = "NVIDIA D14P2-30"
NVIDIA_DEV.11C2 = "NVIDIA GK106"
NVIDIA_DEV.1281 = "NVIDIA D15M2-05"
NVIDIA_DEV.1282 = "NVIDIA D15M2-20"
NVIDIA_DEV.1283 = "NVIDIA D15M2-10"
NVIDIA_DEV.1285 = "NVIDIA GK208-100"
NVIDIA_DEV.1290 = "NVIDIA GeForce GT 730M "
NVIDIA_DEV.1291 = "NVIDIA GeForce GT 735M"
NVIDIA_DEV.1293 = "NVIDIA GeForce GT 730M "
NVIDIA_DEV.1294 = "NVIDIA GeForce GT 740M "
NVIDIA_DEV.12A0 = "NVIDIA GK208"
NVIDIA_DEV.12AD = "NVIDIA GK208-ES"
NVIDIA_DEV.12AE = "NVIDIA GK208-CS1-C"
NVIDIA_DEV.12AF = "NVIDIA GK208-INT"
NVIDIA_DEV.12B0 = "NVIDIA GK208-CS-Q"
NVIDIA_DEV.12B1 = "NVIDIA GK208 INT"
 
Last edited:
Top