Monday, July 21st 2025
NVIDIA Ports CUDA to RISC-V, Betting Big on Open-Source ISA
During the RISC-V Summit in China, NVIDIA's Frans Sijstermans, vice president of hardware engineering, officially announced that NVIDIA has ported its massive CUDA software library to RISC-V ISA, signaling that the company sees RISC-V adoption accelerating in every aspect of the hardware stack, and that it could be a perfect match for NVIDIA GPUs. Historically, NVIDIA ported its CUDA platform to every major instruction set, including x86, Arm, PowerPC, and even Sun's SPARC. This is done to ensure that if any platform takes off in the enterprise or any segment, NVIDIA is there from the start to support it and allow its GPUs to run at full speed. Now, the $4 trillion company is making a bet that RISC-V will be the next desirable ISA to bring full support for.
NVIDIA envisions systems where its GPUs are the center of any acceleration, and supplementary RISC-V CPUs oversee CUDA drivers, application logic, and the operating system, orchestrating parallel workloads entirely within the CUDA ecosystem. The diagram shown at the summit highlights a DPU handling networking tasks, creating a cohesive trio of compute, control, and data-movement elements. If you recall, NVIDIA already uses NV-RISC-V CPU inside its GPUs for handling control logic on the GPU itself. That demonstrates NVIDIA's strategy to build heterogeneous platforms that combine RISC-V controllers with its GPUs, DPUs, and networking silicon. Now that CUDA is fully supported on RISC-V, NVIDIA could look into alternatives for its Grace CPU to be built on the RISC-V ISA. As the open-source ISA slowly breaks into the server space with the RVA23 specification, which NVIDIA mandates for CUDA support, we could see some interesting heterogeneous designs.RISC-V Foundation CEO Andrea Gallo, in an interview with TechPowerUp, confirmed that "There's a team that is working on a server SOC and a server platform. This includes things like having the same interfaces for timers, clock, IOMMU, RAS and the related error reporting mechanisms. We all agree that we should use the same interfaces for specific peripherals, that are part, for example, of a server platform." This puts confidence that there are companies preparing a major debut of RISC-V CPUs for server, and HPC too. We can't wait to see what the market will bring now, given that the world's most valuable company is now backing the world's largest open-source ISA industry movement.
Sources:
RISC-V on X, via Tom's Hardware
NVIDIA envisions systems where its GPUs are the center of any acceleration, and supplementary RISC-V CPUs oversee CUDA drivers, application logic, and the operating system, orchestrating parallel workloads entirely within the CUDA ecosystem. The diagram shown at the summit highlights a DPU handling networking tasks, creating a cohesive trio of compute, control, and data-movement elements. If you recall, NVIDIA already uses NV-RISC-V CPU inside its GPUs for handling control logic on the GPU itself. That demonstrates NVIDIA's strategy to build heterogeneous platforms that combine RISC-V controllers with its GPUs, DPUs, and networking silicon. Now that CUDA is fully supported on RISC-V, NVIDIA could look into alternatives for its Grace CPU to be built on the RISC-V ISA. As the open-source ISA slowly breaks into the server space with the RVA23 specification, which NVIDIA mandates for CUDA support, we could see some interesting heterogeneous designs.RISC-V Foundation CEO Andrea Gallo, in an interview with TechPowerUp, confirmed that "There's a team that is working on a server SOC and a server platform. This includes things like having the same interfaces for timers, clock, IOMMU, RAS and the related error reporting mechanisms. We all agree that we should use the same interfaces for specific peripherals, that are part, for example, of a server platform." This puts confidence that there are companies preparing a major debut of RISC-V CPUs for server, and HPC too. We can't wait to see what the market will bring now, given that the world's most valuable company is now backing the world's largest open-source ISA industry movement.

26 Comments on NVIDIA Ports CUDA to RISC-V, Betting Big on Open-Source ISA
*sigh* I thought we went through that already in that market cap thread. Now even the news posters fail to understand what it is? NVidia is not, in fact, largest company in anything except for specifically GPGPUs, let alone the overall world’s largest company. Unless one also believes that Tesla is the world’s largest automaker.
Interesting!
Or when they are not the first batch ... Improved Nvidia Gpu ....
This OP is about Nvidia's compute stack being able to be built and run on RISC-V, alongside ARM and x86_64.
AMD's equivalent compute stack, ROCm, is already able to be built for RISC-V, among other ISAs as well.
(or maybe you just did some nice puns and I missed the point of the joke)Both Intel's and AMD's stack are already able to run on RISC-V.Nvidia's kernel modules are already open source, but were not really able to be built for RISC-V. Seems like this will be changing (there's even an open issue in their github repo, iirc).
Most of their userspace components are proprietary, seems like those will also have RISC-V options from now on.
Given that CUDA is a mix of both drivers + userspace components, the title in the OP is still accurate.
A serious chunk of change.
I can't help but feel like this was nVidia's secret weapon against AMD and Intel gaining traction in the 'scalable' AI market.
Companies like Tiny have been (figuratively) screaming for hardware options beyond nVidia. Seems like this move helps satisfy those demands, without giving nVidia's competitors an inch.More like a RISC-V co-processor/accelerator card? Kinda like a RISC-V Intel Larrabee (conceptually)
Lol
It's almost twice as fast. More than twice as fast in RT. Even more than that in PT.
The 5090 is 1.2x the MI300X.
The MI350X hasn't been tested and is substantially faster than the MI300X. It does FP4 (3.5x Int8) for AI. 50% faster memory. Twice the TDP at 1000w.
RISC-V can be Nvidia's own IP that no one can take away, that's the benefit versus working with MediaTek/ARM or x86 CPU.
No immediate news from a RISC-V CPU from Nvidia, just speculation.RISC-V is an ISA, not a core. Many different core designs can be made using a specific ISA.
A ISA has no direct relationship to a core being made for performance, efficiency or size.OpenCL has been pretty much abandoned by both Nvidia and AMD. Only Intel still puts some love in it.
Comparing the performance numbers for either AMD or Nvidia products on such stack is throwing performance away. Even with Vulkan you can easily get 2~10x more performance.
Using the vendor-specific stack (like CUDA or ROCm) nets an even bigger performance uplift. Also, lots of features aren't even supported within OpenCL, such as Nvidia not having fp16 support in that stack.