• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA to Put DGX Computers in the Cloud, Becomes AI-as-a-Service Provider

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,259 (0.92/day)
NVIDIA has recently reported its Q4 earnings, and the earnings call following the report contains exciting details about the company and its plans to open up to new possibilities. NVIDIA's CEO Jensen Huang has stated that the company is on track to become an AI-as-a-Service (AIaaS) provider, which technically makes it a cloud service provider (CSP). "Today, I want to share with you the next level of our business model to help put AI within reach of every enterprise customer. We are partnering with major service -- cloud service providers to offer NVIDIA AI cloud services, offered directly by NVIDIA and through our network of go-to-market partners, and hosted within the world's largest clouds." Said Mr. Huang, adding that "NVIDIA AI as a service offers enterprises easy access to the world's most advanced AI platform, while remaining close to the storage, networking, security and cloud services offered by the world's most advanced clouds. Customers can engage NVIDIA AI cloud services at the AI supercomputer, acceleration library software, or pretrained AI model layers."

In addition to enrolling other CSPs into the race, NVIDIA is also going to offer DGX machines on demand in the cloud. Using select CSPs, you can get access to an entire DGX and harness the computing power for AI research purposes. Mr. Huang noted "NVIDIA DGX is an AI supercomputer, and the blueprint of AI factories being built around the world. AI supercomputers are hard and time-consuming to build. Today, we are announcing the NVIDIA DGX Cloud, the fastest and easiest way to have your own DGX AI supercomputer, just open your browser. NVIDIA DGX Cloud is already available through Oracle Cloud Infrastructure and Microsoft Azure, Google GCP, and others on the way."



View at TechPowerUp Main Site | Source
 
Joined
Feb 18, 2005
Messages
5,331 (0.76/day)
Location
Ikenai borderline!
System Name Firelance.
Processor Threadripper 3960X
Motherboard ROG Strix TRX40-E Gaming
Cooling IceGem 360 + 6x Arctic Cooling P12
Memory 8x 16GB Patriot Viper DDR4-3200 CL16
Video Card(s) MSI GeForce RTX 4060 Ti Ventus 2X OC
Storage 2TB WD SN850X (boot), 4TB Crucial P3 (data)
Display(s) 3x AOC Q32E2N (32" 2560x1440 75Hz)
Case Enthoo Pro II Server Edition (Closed Panel) + 6 fans
Power Supply Fractal Design Ion+ 2 Platinum 760W
Mouse Logitech G602
Keyboard Logitech G613
Software Windows 10 Professional x64
Joined
Feb 11, 2009
Messages
5,411 (0.97/day)
System Name Cyberline
Processor Intel Core i7 2600k -> 12600k
Motherboard Asus P8P67 LE Rev 3.0 -> Gigabyte Z690 Auros Elite DDR4
Cooling Tuniq Tower 120 -> Custom Watercoolingloop
Memory Corsair (4x2) 8gb 1600mhz -> Crucial (8x2) 16gb 3600mhz
Video Card(s) AMD RX480 -> RX7800XT
Storage Samsung 750 Evo 250gb SSD + WD 1tb x 2 + WD 2tb -> 2tb MVMe SSD
Display(s) Philips 32inch LPF5605H (television) -> Dell S3220DGF
Case antec 600 -> Thermaltake Tenor HTCP case
Audio Device(s) Focusrite 2i4 (USB)
Power Supply Seasonic 620watt 80+ Platinum
Mouse Elecom EX-G
Keyboard Rapoo V700
Software Windows 10 Pro 64bit
ah yes, the dream, everything as a service, everything with a monthly payment subscription.
 
Joined
Apr 24, 2020
Messages
2,569 (1.73/day)
ah yes, the dream, everything as a service, everything with a monthly payment subscription.

DGX computers are well over $200,000, even for the older models. I wouldn't be surprised if the H100 model were hitting $1MM or more. These are computers that absolutely should be subscribed to, unless your organization 100% knows its going to actually use them effectively.

Honestly, $10,000/month for access to a DGX computer is 100% worthwhile, especially if you're in the "Lets see if my developers even can benefit from this kind of computer" phase for your organization. No point sinking $200k, $300k, or more into an expensive paperweight.
 
Joined
Feb 20, 2020
Messages
9,340 (6.03/day)
Location
Louisiana
System Name Ghetto Rigs z490|x99|Acer 17 Nitro 7840hs/ 5600c40-2x16/ 4060/ 1tb acer stock m.2/ 4tb sn850x
Processor 10900k w/Optimus Foundation | 5930k w/Black Noctua D15
Motherboard z490 Maximus XII Apex | x99 Sabertooth
Cooling oCool D5 res-combo/280 GTX/ Optimus Foundation/ gpu water block | Blk D15
Memory Trident-Z Royal 4000c16 2x16gb | Trident-Z 3200c14 4x8gb
Video Card(s) Titan Xp-water | evga 980ti gaming-w/ air
Storage 970evo+500gb & sn850x 4tb | 860 pro 256gb | Acer m.2 1tb/ sn850x 4tb| Many2.5" sata's ssd 3.5hdd's
Display(s) 1-AOC G2460PG 24"G-Sync 144Hz/ 2nd 1-ASUS VG248QE 24"/ 3rd LG 43" series
Case D450 | Cherry Entertainment center on Test bench
Audio Device(s) Built in Realtek x2 with 2-Insignia 2.0 sound bars & 1-LG sound bar
Power Supply EVGA 1000P2 with APC AX1500 | 850P2 with CyberPower-GX1325U
Mouse Redragon 901 Perdition x3
Keyboard G710+x3
Software Win-7 pro x3 and win-10 & 11pro x3
Benchmark Scores Are in the benchmark section
Joined
Oct 18, 2017
Messages
149 (0.06/day)
System Name Battlestation
Processor intel i9 9900K
Motherboard EVGA Z370 FTW
Cooling Noctua NH-D15
Memory 2X8 GB DDR4 3200 Mhz Corsair
Video Card(s) Nvidia RTX 4070 Founders Edition
Storage Western Digital SN850 1 TB NVME
Display(s) Asus PG248Q
Case Phanteks P600S
Audio Device(s) Steelseries Arctis pro
Power Supply EVGA 1200 P2
Mouse Logitech G PRO
Keyboard Logitech G710+
Benchmark Scores https://www.3dmark.com/spy/38948601 https://i.ibb.co/1MDLrVz/apres.jpg
If nvidia's AI technology was so great, it would probably tell them to stop taking customers for pigeons
 
Joined
Nov 18, 2010
Messages
7,146 (1.45/day)
Location
Rīga, Latvia
System Name HELLSTAR
Processor AMD RYZEN 9 5950X
Motherboard ASUS Strix X570-E
Cooling 2x 360 + 280 rads. 3x Gentle Typhoons, 3x Phanteks T30, 2x TT T140 . EK-Quantum Momentum Monoblock.
Memory 4x8GB G.SKILL Trident Z RGB F4-4133C19D-16GTZR 14-16-12-30-44
Video Card(s) Sapphire Pulse RX 7900XTX + under waterblock through Kryosheet
Storage Optane 900P[W11] + WD BLACK SN850X 4TB + 750 EVO 500GB + 1TB 980PRO[FEDORA]
Display(s) Philips PHL BDM3270 + Acer XV242Y
Case Lian Li O11 Dynamic EVO
Audio Device(s) Sound Blaster ZxR
Power Supply Fractal Design Newton R3 1000W
Mouse Razer Basilisk
Keyboard Razer BlackWidow V3 - Yellow Switch
Software FEDORA 40
Hi,
Wild typo
Then you start finding unknown processes in your gpu driver.

You meant more unknown processes besides ones that are already are there :D
 

bug

Joined
May 22, 2015
Messages
13,273 (4.04/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
And just the other day, in the thread about AMD almost matching Nvidia in gaming revenue, I was pointing out there's this new market where AMD is virtually non-existent.
I know, smaller player, can't tackle everything at once, but it still seems like they're missing out big time.
 
Joined
Mar 4, 2011
Messages
304 (0.06/day)
Location
Canada
System Name Something Esoteric 2
Processor Ryzen 7 7800X3D
Motherboard ASUS Prime B650-Plus
Cooling Corsair H150i Elite Capellix 360MM AIO
Memory 64GB Corsair Vengeance 6000Mhz DDR5
Video Card(s) MSI Ventus RTX 3090 OC 24GB
Storage WD Black SN850X 2TB NVMe
Display(s) 2 x Dell S2721DGF IPS
Case Corsair 4000D Airflow Tempered Glass
Audio Device(s) Samsung Buds2 Pro, SteelSeries Siberia 800
Power Supply EVGA 1200W P3 80+ Platinum
Mouse Logitech G903
Keyboard Microsoft Sidewinder X6
Software Windows 11 Pro
PC gaming is going to be the first gaming platform to do this. That's why it's the master race.

I detected the /s, but if this comes to pass are you sure we'd still be the masters in that arrangement?
thinking-face.256x254.png
 
Joined
Apr 13, 2022
Messages
998 (1.30/day)
I detected the /s, but if this comes to pass are you sure we'd still be the masters in that arrangement? View attachment 285687

Wasn't sarcastic at all. PC gaming will go to the cloud and lead the consoles there. As it always has been. PC is the cloud gaming leader. Always has been, always will be. And PC gaming will lead the charge in paying for frames, paying for refresh rates, and paying for details setting. PC gaming is the issue. Always was, currently is, always will be.

It will still have better RGB though. That's what you're going to get on the PC. Pay for service, pay for frame rates, pay for refresh items, pay for details settings, but you will own the RGB!
 
Joined
Aug 14, 2013
Messages
2,373 (0.60/day)
System Name boomer--->zoomer not your typical millenial build
Processor i5-760 @ 3.8ghz + turbo ~goes wayyyyyyyyy fast cuz turboooooz~
Motherboard P55-GD80 ~best motherboard ever designed~
Cooling NH-D15 ~double stack thot twerk all day~
Memory 16GB Crucial Ballistix LP ~memory gone AWOL~
Video Card(s) MSI GTX 970 ~*~GOLDEN EDITION~*~ RAWRRRRRR
Storage 500GB Samsung 850 Evo (OS X, *nix), 128GB Samsung 840 Pro (W10 Pro), 1TB SpinPoint F3 ~best in class
Display(s) ASUS VW246H ~best 24" you've seen *FULL HD* *1O80PP* *SLAPS*~
Case FT02-W ~the W stands for white but it's brushed aluminum except for the disgusting ODD bays; *cries*
Audio Device(s) A LOT
Power Supply 850W EVGA SuperNova G2 ~hot fire like champagne~
Mouse CM Spawn ~cmcz R c00l seth mcfarlane darawss~
Keyboard CM QF Rapid - Browns ~fastrrr kees for fstr teens~
Software integrated into the chassis
Benchmark Scores 9999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999
Preeeeety sure xbox cloud whatever has far more users than any pc based streaming service but yeah, saas is the future, for better or worse
 
Top