• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Introduces RAPIDS Open-Source GPU-Acceleration Platform

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
35,745 (8.87/day)
Likes
18,207
Location
Hyderabad, India
System Name Crypto-plague Survival Kit
Processor Intel Core i7-4770K
Motherboard ASUS Z97-A
Cooling Xigmatek Aegir CPU Cooler
Memory 2x 8GB Kingston HyperX Beast DDR3-1866
Video Card(s) Colorful iGame GTX 1070 Ti Vulcan X
Storage ADATA SU800 512GB + Intel SSD320 120GB + Patriot WildFire 120GB
Display(s) Samsung U28D590 28-inch 4K UHD
Case Corsair Carbide 100R
Audio Device(s) Creative Sound Blaster Recon3D PCIe
Power Supply Corsair HX850W
Mouse Razer Abyssus
Keyboard Microsoft Sidewinder X4
Software Windows 10 Pro
#1
NVIDIA today announced a GPU-acceleration platform for data science and machine learning, with broad adoption from industry leaders, that enables even the largest companies to analyze massive amounts of data and make accurate business predictions at unprecedented speed.

RAPIDS open-source software gives data scientists a giant performance boost as they address highly complex business challenges, such as predicting credit card fraud, forecasting retail inventory and understanding customer buying behavior. Reflecting the growing consensus about the GPU's importance in data analytics, an array of companies is supporting RAPIDS - from pioneers in the open-source community, such as Databricks and Anaconda, to tech leaders like Hewlett Packard Enterprise, IBM and Oracle.



Analysts estimate the server market for data science and machine learning at $20 billion annually, which - together with scientific analysis and deep learning - pushes up the value of the high performance computing market to approximately $36 billion.

"Data analytics and machine learning are the largest segments of the high performance computing market that have not been accelerated - until now," said Jensen Huang, founder and CEO of NVIDIA, who revealed RAPIDS in his keynote address at the GPU Technology Conference. "The world's largest industries run algorithms written by machine learning on a sea of servers to sense complex patterns in their market and environment, and make fast, accurate predictions that directly impact their bottom line.

"Building on CUDA and its global ecosystem, and working closely with the open-source community, we have created the RAPIDS GPU-acceleration platform. It integrates seamlessly into the world's most popular data science libraries and workflows to speed up machine learning. We are turbocharging machine learning like we have done with deep learning," he said.

RAPIDS offers a suite of open-source libraries for GPU-accelerated analytics, machine learning and, soon, data visualization. It has been developed over the past two years by NVIDIA engineers in close collaboration with key open-source contributors.

For the first time, it gives scientists the tools they need to run the entire data science pipeline on GPUs. Initial RAPIDS benchmarking, using the XGBoost machine learning algorithm for training on an NVIDIA DGX-2 system, shows 50x speedups compared with CPU-only systems. This allows data scientists to reduce typical training times from days to hours, or from hours to minutes, depending on the size of their dataset.

Close Collaboration with Open-Source Community
RAPIDS builds on popular open-source projects - including Apache Arrow, pandas and scikit-learn - by adding GPU acceleration to the most popular Python data science toolchain. To bring additional machine learning libraries and capabilities to RAPIDS, NVIDIA is collaborating with such open-source ecosystem contributors as Anaconda, BlazingDB, Databricks, Quansight and scikit-learn, as well as Wes McKinney, head of Ursa Labs and creator of Apache Arrow and pandas, the fastest-growing Python data science library.

"RAPIDS, a GPU-accelerated data science platform, is a next-generation computational ecosystem powered by Apache Arrow," McKinney said. "NVIDIA's collaboration with Ursa Labs will accelerate the pace of innovation in the core Arrow libraries and help bring about major performance boosts in analytics and feature engineering workloads."

To facilitate broad adoption, NVIDIA is integrating RAPIDS into Apache Spark, the leading open-source framework for analytics and data science.

"At Databricks, we are excited about RAPIDS' potential to accelerate Apache Spark workloads," said Matei Zaharia, co-founder and chief technologist of Databricks, and original creator of Apache Spark. "We have multiple ongoing projects to integrate Spark better with native accelerators, including Apache Arrow support and GPU scheduling with Project Hydrogen. We believe that RAPIDS is an exciting new opportunity to scale our customers' data science and AI workloads."

Broad Ecosystem Support and Adoption
Tech-leading enterprises across a broad range of industries are early adopters of NVIDIA's GPU-acceleration platform and RAPIDS.

"NVIDIA's GPU-acceleration platform with RAPIDS software has immensely improved how we use data - enabling the most complex models to run at scale and deliver even more accurate forecasting," said Jeremy King, executive vice president and chief technology officer at Walmart. "RAPIDS has its roots in deep collaboration between NVIDIA's and Walmart's engineers, and we plan to build on this relationship."

Additionally, some of the world's leading technology companies are supporting RAPIDS through new systems, data science platforms and software solutions:

"HPE is committed to advancing the way customers live and work. Artificial intelligence, analytics and machine learning technology can play a critical role in uncovering insights that can help customers achieve breakthrough results and improve the world we live in. HPE is unique in the market in that we provide complete AI and data analytics solutions from strategic advisory to purpose-built GPU accelerator technology, operational support and a strong partner ecosystem to tailor the right solution for each customer. We are excited to partner with NVIDIA on RAPIDS to accelerate the application of data science and machine learning to help our customers drive faster and more insightful outcomes."
- Antonio Neri, CEO, Hewlett Packard Enterprise

"IBM has built the world's leading platform for enterprise AI, regardless of deployment model. We look forward to extending our successful partnership with NVIDIA, leveraging RAPIDS to provide new machine learning tools for our clients."
- Arvind Krishna, senior vice president of Hybrid Cloud and director of IBM Research

"The compute world today requires powerful processing to handle complex workloads like data science and analytics - it's a job for NVIDIA GPUs. RAPIDS is accelerating the speed at which this processing and machine learning training can be done. We are excited to support this new suite of open-source software natively on Oracle Cloud Infrastructure and look forward to working with NVIDIA to support RAPIDS across our platform, including the Oracle Data Science Cloud, to further accelerate our customers' end to-end data science workflows. RAPIDS software runs seamlessly on the Oracle Cloud, allowing customers to support their HPC, AI and data science needs, all while taking advantage of the portfolio of GPU instances available on Oracle Cloud Infrastructure."
- Clay Magouyrk, senior vice president of Software Development, Oracle Cloud Infrastructure

Support from other leading innovators - including Cisco, Dell EMC, Lenovo, NERSC, NetApp, Pure Storage, SAP and SAS, as well as a wide range of data science pioneers - is appended to this press release.

Availability
Access to the RAPIDS open-source suite of libraries is immediately available at http://rapids.ai/, where the code is being released under the Apache license. Containerized versions of RAPIDS will be available this week on the NVIDIA GPU Cloud container registry.
 
Joined
Jul 16, 2014
Messages
2,486 (1.60/day)
Likes
1,269
Location
SE Michigan
System Name Dumbass
Processor AMD-9370BE @4.6
Motherboard ASUS SABERTOOTH 990FX R2.0 +SB950
Cooling CM Nepton 280L
Memory G.Skill Sniper 16gb DDR3 2400
Video Card(s) GreenTeam 1080 Gaming X 8GB
Storage C:\SSD (240GB), D:\Seagate (2TB), E:\Western Digital (1TB)
Display(s) 1x Nixeus NX_EDG27, 2x Dell S2440L (16:9)
Case Phanteks Enthoo Primo w/8 140mm SP Fans
Audio Device(s) onboard (realtek?) SPKRS:Logitech Z623 200w 2.1
Power Supply Corsair HX1000i
Mouse Logitech G700s
Keyboard Logitech G910 Orion Spark
Software windows 10
Benchmark Scores https://i.imgur.com/aoz3vWY.jpg?2
#3
Joined
Aug 27, 2015
Messages
414 (0.36/day)
Likes
265
Location
In the middle of nowhere
System Name Scrapped Parts, Unite !
Processor i5-2500 @ 3.3 Ghz//Q9300 @ 2.5 Ghz
Motherboard GA-H67MA-USB3-B3// P35 Neo2-FR
Cooling Stock
Memory 10 GB DDR3 1333 // 3 GB DDR2
Video Card(s) Colorful iGame GeForce GTX1060 Vulcan U 6G // ASUS ENGT 220 1GD3
Storage Hitachi 500 GB, Sony 1TB, KINGSTON 400A 120GB // Samsung 160 GB
Display(s) HP 2009f
Case Xigmatek Asgard Pro // Cooler Master Centurion 5
Audio Device(s) Onboard
Power Supply OCZ ModXStream Pro 500 W
Software Windows 10 x64
Benchmark Scores Minesweeper 30fps, Tetris 40 fps, with overheated CPU and GPU
#4
1. this is terrific news
2. anything open-sources and nvidia never mix well
3. anything utilize hardware that exclusive only for nvidia is NOT open source,
although in the article said that nvidia 'work' with open sources community closely. (more like to 'convert them' to nvidia ecosystem, in my 2c).
 
Joined
Jul 16, 2014
Messages
2,486 (1.60/day)
Likes
1,269
Location
SE Michigan
System Name Dumbass
Processor AMD-9370BE @4.6
Motherboard ASUS SABERTOOTH 990FX R2.0 +SB950
Cooling CM Nepton 280L
Memory G.Skill Sniper 16gb DDR3 2400
Video Card(s) GreenTeam 1080 Gaming X 8GB
Storage C:\SSD (240GB), D:\Seagate (2TB), E:\Western Digital (1TB)
Display(s) 1x Nixeus NX_EDG27, 2x Dell S2440L (16:9)
Case Phanteks Enthoo Primo w/8 140mm SP Fans
Audio Device(s) onboard (realtek?) SPKRS:Logitech Z623 200w 2.1
Power Supply Corsair HX1000i
Mouse Logitech G700s
Keyboard Logitech G910 Orion Spark
Software windows 10
Benchmark Scores https://i.imgur.com/aoz3vWY.jpg?2
#5
Joined
Jun 28, 2016
Messages
1,581 (1.87/day)
Likes
467
#6
There's a discussion going on where you can find links to statistics showing that Nvidia is a larger contributor to open source than you think (for starters: larger than AMD). :)
 
Last edited by a moderator:
Joined
Dec 15, 2009
Messages
201 (0.06/day)
Likes
39
Location
Austria
System Name bazinga 2.8
Processor i7 2600k @ 4.4GHz
Motherboard ASrock Z77 Extreme 6
Cooling Corsair H100i GT
Memory 32GB 1600Mhz
Video Card(s) MSi GTX 980Ti G6 1506/4005
Storage 512GB 840EVO, 3TB HDD
Display(s) BenQ XL2420T |BenQ XL2411T
Case Nanoxia Deep Silence 6
Audio Device(s) Creative Sound Blaster X-Fi Titanium
Power Supply EVGA 1000G2
Software Win10 x64
#7
Open-Source you say hmmm, RAPIDS Homepage says "It relies on NVIDIA® CUDA® " :rolleyes:
 

95Viper

Moderator
Staff member
Joined
Oct 12, 2008
Messages
5,883 (1.61/day)
Likes
2,770
Location
στο άλφα έως ωμέγα
System Name Ha/AhHa/Dell
Processor QX9650 SLAWN C1/i7-980x/i7-6700K
Motherboard GA-X48_DS4 (F3B bios)/Gigabyte x58A-UDR3 v 2.0(modded FH bios)/Dell Foxconn 0XJ8C4 Z170
Cooling CNPS9900 LED/H60/ 3 pipe-center fan-air
Memory 8 Gig of G.Skill F2-8800CL5D/24 Gb Corsair Vengence/ 24Gb Samsung DDR4 2133
Video Card(s) Galaxy NVIDIA GeForce GTX 960/PowerColor R9 280/ASUS R9 380X Strix G1
Storage All have SSDs with HDDs for extra storage and backup/Dell-M.2 Samsung 850 EVO PCIe
Display(s) Viewsonic 1080p/HP ZR24W/Auria EQ278C
Case CM-690/CM-690 II adv/Dell 8900 series
Audio Device(s) All use on board (Realtek) w/2.1 speakers
Power Supply PC P&C 750/PC P&C Silencer 950/CM 700 Extreme
Mouse Logitech
Keyboard Logitech
Software Windows 10 Pro - 64 bit/Windows 10 Pro - 64bit/Windows 10 Pro - 64bit
#8
Let's stay on topic, no insulting others and, definitely, no them versus us type of off topic jabs.
Thank You
 
Joined
Sep 15, 2007
Messages
3,208 (0.79/day)
Likes
1,110
Location
Police/Nanny State of America
System Name More hardware than I use :|
Processor 4.7 8350 - 4.2 4560K - 4.4 4690K
Motherboard Sabertooth R2.0 - Gigabyte Z87X-UD4H-CF - AsRock Z97M KIller
Cooling Mugen 2 rev B push/pull - Hyper 212+ push/pull - Hyper 212+
Memory 16GB Gskill - 8GB Gskill - 16GB Ballistix 1.35v
Video Card(s) Xfire OCed 7950s - Powercolor 290x - Oced Zotac 980Ti AMP! (also have two 7870s)
Storage Crucial 250GB SSD, Kingston 3K 120GB, Sammy 1TB, various WDs, 13TB (actual capactity) NAS with WDs
Display(s) X-star 27" 1440 - Auria 27" 1440 - BenQ 24" 1080 - Acer 23" 1080
Case Lian Li open bench - Fractal Design ARC - Thermaltake Cube (still have HAF 932 and more ARCs)
Audio Device(s) Titanium HD - Onkyo HT-RC360 Receiver - BIC America custom 5.1 set up (and extra Klipsch sub)
Power Supply Corsair 850W V2 - EVGA 1000 G2 - Seasonic 500 and 600W units (dead 750W needs RMA lol)
Mouse Logitech G5 - Sentey Revolution Pro - Sentey Lumenata Pro - multiple wireless logitechs
Keyboard Logitech G11s - Thermaltake Challenger
Software I wish I could kill myself instead of using windows (OSX can suck it too).
#9
There's a discussion going on where you can find links to statistics showing that Nvidia is a larger contributor to open source than you bigots think (for starters: larger than AMD). :)
You mean like when they said low level APIs are useless (talking about Mantle), but as soon as Khronos Group was formed/developing Vulkan, which was clear to be the new, universal, API, then they immediately jump on board? LOL
They're liars through and through. They were terrified of AMD getting an upper hand with it, so they had to join. And that's all you need to know about how useless DX is, too.
 
Joined
Nov 18, 2010
Messages
4,084 (1.41/day)
Likes
2,373
Location
Rīga, Latvia
System Name HELLSTAR
Processor Intel 5960X @ 4.4GHz
Motherboard Gigabyte GA-X99-UD3
Cooling Custom Loop. 360+240 rads.
Memory 4x8GB Corsair Vengeance LPX 2966MHz 16-17-17-35
Video Card(s) ASUS 1080 Ti FE + water block
Storage Optane 900P + Samsung 950Pro 256GB NVMe + 750 EVO 500GB
Display(s) Philips PHL BDM3270
Case Phanteks Enthoo Evolv ATX Tempered Glass
Audio Device(s) Sound Blaster ZxR
Power Supply Fractal Design Newton R3 1000W
Mouse Razer Basilisk
Keyboard Razer Deathstalker
Software Windows 10 insider
#10
Joined
Jul 10, 2011
Messages
640 (0.24/day)
Likes
277
Processor Intel
Motherboard MSI
Cooling Cooler Master
Memory Corsair
Video Card(s) Nvidia
Storage Samsung/Western Digital
Display(s) Samsung
Case Thermaltake
Audio Device(s) On Board
Power Supply EVGA
Mouse A4TECH
Keyboard UniKey
Software Windows 10 x64
#11
1. this is terrific news
2. anything open-sources and nvidia never mix well
3. anything utilize hardware that exclusive only for nvidia is NOT open source,
although in the article said that nvidia 'work' with open sources community closely. (more like to 'convert them' to nvidia ecosystem, in my 2c).
Open-Source you say hmmm, RAPIDS Homepage says "It relies on NVIDIA® CUDA® " :rolleyes:
Radeon Open Compute Platform (ROCm), the Most Versatile Open Source Platform for GPU Computing

 
Joined
Mar 24, 2012
Messages
284 (0.12/day)
Likes
59
#14
1. this is terrific news
2. anything open-sources and nvidia never mix well
3. anything utilize hardware that exclusive only for nvidia is NOT open source,
although in the article said that nvidia 'work' with open sources community closely. (more like to 'convert them' to nvidia ecosystem, in my 2c).
1) it's a good news no doubt.
2) is that so? while nvidia seems anti open source to many they might contribute many more to open source than some other that keep preaching about "open". some things might not work well (like their open source driver for deskstop GPU) but others like their open source driver support for tegra has been very good. why did you think nintendo switch was easily hack? part of the reason was the chip is very well known due to their effort to make the chip spec and documentation is very accessible to open source community.
3) did nvidia restrict this RAPID platform specifically to use nvidia GPU only? or else you can't do anything about it?

And below those lines, we have this -
CUDA is hardware specific. ROCm softwares use C++ and OpenCL, right?
CUDA is not hardware specific. it is more optimized for nvidia hardware but it can run on any hardware. Qualcomm for example made their snapdragon chip to be able to run nvidia cuDNN.
 
Joined
Jun 28, 2016
Messages
1,581 (1.87/day)
Likes
467
#15
And below those lines, we have this -
CUDA is hardware specific. ROCm softwares use C++ and OpenCL, right?
But Nvidia card users can program using both CUDA and ROCm. And OpenCL. And other libraries as well.
We choose CUDA, because it's simply easier and more effective.
 
Joined
Feb 25, 2016
Messages
83 (0.09/day)
Likes
31
#16
But Nvidia card users can program using both CUDA and ROCm. And OpenCL. And other libraries as well.
We choose CUDA, because it's simply easier and more effective.
CUDA was released in 2007. There was no competition and since then it has the market firmly in its hold.

CUDA is not hardware specific. it is more optimized for nvidia hardware but it can run on any hardware. Qualcomm for example made their snapdragon chip to be able to run nvidia cuDNN.
Can you give links for this? Is Qualcomm doing it like AMD did with Boltzmann Initiative?
 
Joined
Jun 28, 2016
Messages
1,581 (1.87/day)
Likes
467
#17
CUDA was released in 2007. There was no competition and since then it has the market firmly in its hold.
Not true. There were other languages you could use even way before CUDA was born. I've coded in Brook in high school, few years before CUDA was launched.
The difference was: everything before CUDA was cumbersome and with steep learning curve. In many ways these were typical open-source projects - lacking someone taking care of esthetics and friendliness.

Keep in mind what was happening in the period we're talking about. We're in mid 2000s. Yesterday, coding was really just for programmers and some scientists (mathematicians, physicists etc). But everything is changing: suddenly coding is becoming a basic skill for economists, analysts and so on.
Nvidia was the first to notice that GPGPU could be useful for someone other than hardcore low-level programmers. Simple as that.
10 years later none of the more modern APIs offer similar combination of effectiveness and simplicity. And IT industry is really flexible. During those 10 years NoSQL eat a big portion of RDBMS market, Python became more popular than C++ et cetera. Nothing even touched CUDA's dominance.

The cost? You need Nvidia hardware. It's negligible.
 
Joined
Feb 25, 2016
Messages
83 (0.09/day)
Likes
31
#18
Not true. There were other languages you could use even way before CUDA was born. I've coded in Brook in high school, few years before CUDA was launched.
The difference was: everything before CUDA was cumbersome and with steep learning curve. In many ways these were typical open-source projects - lacking someone taking care of esthetics and friendliness.

Keep in mind what was happening in the period we're talking about. We're in mid 2000s. Yesterday, coding was really just for programmers and some scientists (mathematicians, physicists etc). But everything is changing: suddenly coding is becoming a basic skill for economists, analysts and so on.
Nvidia was the first to notice that GPGPU could be useful for someone other than hardcore low-level programmers. Simple as that.
10 years later none of the more modern APIs offer similar combination of effectiveness and simplicity. And IT industry is really flexible. During those 10 years NoSQL eat a big portion of RDBMS market, Python became more popular than C++ et cetera. Nothing even touched CUDA's dominance.

The cost? You need Nvidia hardware. It's negligible.
Wasn't I saying the same thing? CUDA had no competition when it was released. Some programs here and there doesn't mean competition.
 
Joined
Jul 9, 2015
Messages
1,380 (1.15/day)
Likes
424
System Name My all round PC
Processor i5 750
Motherboard ASUS P7P55D-E
Memory 8GB
Video Card(s) Sapphire 380 OC... sold, waiting for 480 with custom cooler
Storage 256GB Samsung SSD + 2Tb + 1.5Tb
Display(s) Samsung 40" A650 TV
Case Thermaltake Chaser mk-I Tower
Power Supply 425w Enermax MODU 82+
Software Windows 10
#19
Top