• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD Develops ROCm-based Solution to Run Unmodified NVIDIA's CUDA Binaries on AMD Graphics

Joined
Oct 24, 2022
Messages
92 (0.16/day)
From now on, the GPU-Z app will have the CUDA and PhysX checkboxes checked for AMD graphics cards.

 
Joined
Dec 30, 2010
Messages
2,108 (0.43/day)
Not gonna complain about the EU pushing for a more open-standard market. Look at what they did to apple, enforcing them to adopt USB-C, worldwide.

EU pushed apple to allow sideloading of apps (that not come through app-store) but also pushed apple to have app creators, use their own payment system rather then through apple store.

I mean it's a fantastic eco-system in regards of software - look at the malware that was resident for years in Google's appstore. Not a thing found through apple.
 
Joined
May 31, 2016
Messages
4,331 (1.49/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
The same has been done on other GPUs - there's FSR. One can argue the minor differences in quality, but regardless of one's personal opinion, the technology is there, and it doesn't need no AI magic to run.
FSR is a different feature (it does the same though) from a different company. I'm talking about the NV proprietary DLSS or FG etc. which is tailored to contribute user only if you have specific hardware that can utilize the feature. FSR has always been hardware agnostic.
 
Joined
Jun 29, 2023
Messages
493 (1.53/day)
Location
Spain
System Name Gungnir
Processor Ryzen 5 7600X @1.25v
Motherboard ASUS TUF B650M-PLUS WIFI
Cooling Thermalright Peerless Assasin 120 SE Black
Memory 2x16GB DDR5 CL36 5600MHz
Video Card(s) XFX RX 6800XT Merc 319 @1.1v @2600MHz clock @2140MHz vram freq. (surprisingly stable)
Storage 1TB WD SN770 | 2TB WD Blue SATA III SSD
Display(s) 1440p 165Hz VA
Case Lian Li Lancool 215
Audio Device(s) Beyerdynamic DT 770 PRO 80Ohm
Power Supply EVGA SuperNOVA 750W 80 Plus Gold
Mouse Logitech G Pro Wireless
Keyboard Keychron V6
VR HMD The bane of my existence (Oculus Quest 2)
This is quite a good stopgap solution while we wait for a proper implementation of AMD's Stream processors, which would easily happen if AMD would sent over some engineers to whatever app they want to help better support their GPUs. It would be good PR and it would show that AMD GPUs can actually be used for production, and that they can compete, the fact that a CUDA translation can get better performance than a native HIP implementation shows that there is much work to be done.

@topic, I find it strange as hell that this gimmick runs faster than AMD's own HIP, it's the same as saying that the company doesn't know its own hardware to create optimized code, in other words, they're underutilizing its capabilities. Incompetence? Lack of investment? What's it lol
My guess? Lack of investment, probably just helped with two lines of code and disappeared, surely they can do a much better job than that if they further invested into implementations.
 
Joined
Feb 21, 2006
Messages
1,997 (0.30/day)
Location
Toronto, Ontario
System Name The Expanse
Processor AMD Ryzen 7 5800X3D
Motherboard Asus Prime X570-Pro BIOS 5013 AM4 AGESA V2 PI 1.2.0.Ca.
Cooling Corsair H150i Pro
Memory 32GB GSkill Trident RGB DDR4-3200 14-14-14-34-1T (B-Die)
Video Card(s) AMD Radeon RX 7900 XTX 24GB (24.5.1)
Storage WD SN850X 2TB / Corsair MP600 1TB / Samsung 860Evo 1TB x2 Raid 0 / Asus NAS AS1004T V2 14TB
Display(s) LG 34GP83A-B 34 Inch 21: 9 UltraGear Curved QHD (3440 x 1440) 1ms Nano IPS 160Hz
Case Fractal Design Meshify S2
Audio Device(s) Creative X-Fi + Logitech Z-5500 + HS80 Wireless
Power Supply Corsair AX850 Titanium
Mouse Corsair Dark Core RGB SE
Keyboard Corsair K100
Software Windows 10 Pro x64 22H2
Benchmark Scores 3800X https://valid.x86.fr/1zr4a5 5800X https://valid.x86.fr/2dey9c
From now on, the GPU-Z app will have the CUDA and PhysX checkboxes checked for AMD graphics cards.

Why would those be checked off?

What does PhsyX have to do with CUDA?
 
Joined
Nov 28, 2012
Messages
418 (0.10/day)
Why would those be checked off?

What does PhsyX have to do with CUDA?
it uses cuda cores to calculate phisics, without a cuda card it would run on cpu with terrible performance and missing features. It was basically Nvidia's way of gatekeeping some game features back then.
 
Joined
Jan 14, 2019
Messages
10,040 (5.15/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
FSR is a different feature (it does the same though) from a different company. I'm talking about the NV proprietary DLSS or FG etc. which is tailored to contribute user only if you have specific hardware that can utilize the feature. FSR has always been hardware agnostic.
Sure, but my point is that if it can be done with a hardware agnostic feature, then there's no need for the NV proprietary one, is there?
 
Joined
May 31, 2016
Messages
4,331 (1.49/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Sure, but my point is that if it can be done with a hardware agnostic feature, then there's no need for the NV proprietary one, is there?
I get your point but you have to understand that reality. NV has a proprietary solution and AMD doesn't and I come from there and build on it. You, on the other hand, say that NV should have made a free for all features, sure but that is not the reality. Instead the reality is, NV said that the set of features mentioned in our conversation is hardware related and cant work on other products of the same kind. The question is here, is that true they cant work with other products and are these features really hardware dependent? I dont state NV should make DLSS of FG free for everybody. They certainly could though but they choose not to.
 
Joined
Nov 8, 2008
Messages
65 (0.01/day)
Still no RTX™ and DLSS™, so who can barely cares about this non event ?
 
Joined
Jan 14, 2019
Messages
10,040 (5.15/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
I get your point but you have to understand that reality. NV has a proprietary solution and AMD doesn't and I come from there and build on it. You, on the other hand, say that NV should have made a free for all features, sure but that is not the reality. Instead the reality is, NV said that the set of features mentioned in our conversation is hardware related and cant work on other products of the same kind. The question is here, is that true they cant work with other products and are these features really hardware dependent? I dont state NV should make DLSS of FG free for everybody. They certainly could though but they choose not to.
So then your point is like saying that Microsoft Office only works on Windows, while my point is like saying that there are various different office solutions available for other OSes too.
 
Joined
Jul 5, 2013
Messages
25,614 (6.46/day)
Trust me, you're joking..

Since Radeon cards are now capable of running CUDA and PhysX code
Not natively they don't.

the GPU-Z application must show the CUDA and PhysX checkboxes checked for AMD graphics cards as well.
They "must" do no such thing.

If the GPU-Z application does not show these checkboxes marked for AMD cards, it will be showing wrong information.
CUDA and PhysX are owned by NVidia, not AMD. Your understanding if the situation seems to be flawed.

So yes, you're joking..
 
Joined
May 31, 2016
Messages
4,331 (1.49/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
So then your point is like saying that Microsoft Office only works on Windows, while my point is like saying that there are various different office solutions available for other OSes too.
that is not my point at all.
 
Joined
Mar 31, 2018
Messages
36 (0.02/day)
The concept is good, but the backend required may be hard to do (missing stuff or parcial support for certain features) and the legal aspects are indeed prohibitive, this is like when Google developed Dalvik, the JIT Java VM that didnt use Java code for Android, then they replaced it with the Android Runtime that compiles the binaries before execution. Google got a big war against Oracle (when Oracle bought Sun) due to this, but got a pat on the back when they settled for no cost (other than legal).

It would be reasonable that AMD pours silently some money on this guy to maintain development of ZLUDA for "educational" purposes, but certainly they can't go full swing on it, is also reasonable that they want to push their own solution.
 
Joined
Jan 14, 2019
Messages
10,040 (5.15/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
that is not my point at all.
Then I'm not sure what you mean.

My point stands: there's no need to push for any hardware-dependent feature when a hardware-agnostic competitor feature is available, minor differences in quality aside.
 
Joined
May 31, 2016
Messages
4,331 (1.49/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
My point stands: there's no need to push for any hardware-dependent feature when a hardware-agnostic competitor feature is available, minor differences in quality aside.
That is beside the point actually. Since you attach to your logic abstraction and speculation not facts. You want NV to be hardware agnostic and you build on that saying AMD has features open. That is true and great.
But NV does not have open features for a reason and the most important question here is, are the features NV offer indeed hardware dependent or is it just advertising scheme to charge more for it? I'm sure NV could go the same route AMD did but they didn't. Do you see my point now? It would seem you are focusing on something here you would want not what it is. I'm not saying i dont support what you said.
 
Joined
Jan 14, 2019
Messages
10,040 (5.15/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
the most important question here is, are the features NV offer indeed hardware dependent or is it just advertising scheme to charge more for it?
Regardless of the answer, I think any hardware-dependent feature is inferior to a competitor one that isn't, unless it's undeniably better (which is not the case with DLSS).

Do you see my point now?
I do. I just don't think that it's relevant from an end user point of view. Other than that, fair enough.
 
Joined
May 31, 2016
Messages
4,331 (1.49/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
Regardless of the answer, I think any hardware-dependent feature is inferior to a competitor one that isn't, unless it's undeniably better (which is not the case with DLSS).
Inferior in what way? DLSS shows better quality and less artifacts than FSR no doubt about it. That does not mean, DLSS has no flaws. FSR can be used by any card you throw at it. I think DLSS is better but inferior in a sense that it has limitation in usage and product it supports which makes FSR more desirable for the majority of users. If there is a thin line in difference in quality between the two, the hardware dependant features is going to be left behind which is very obvious to me. I hope it happens at some point. If you ask me why, in my opinion, paying for features offered in a product, not for the product itself is a fool's errand and in the long run it will fail even though at the beginning it showed potential.

I do. I just don't think that it's relevant from an end user point of view. Other than that, fair enough.
Everything we discuss here is relevant for an end user. Especially the idea that if NV features advertised as hardware dependent are in fact not dependent. Which would mean these could be utilized by any card but instead are being blocked under the proclamation of hardware requirements not being met.
 
Joined
Jan 14, 2019
Messages
10,040 (5.15/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
Inferior in what way? DLSS shows better quality and less artifacts than FSR no doubt about it. That does not mean, DLSS has no flaws. FSR can be used by any card you throw at it. I think DLSS is better but inferior in a sense that it has limitation in usage and product it supports which makes FSR more desirable for the majority of users. If there is a thin line in difference in quality between the two, the hardware dependant features is going to be left behind which is very obvious to me. I hope it happens at some point. If you ask me why, in my opinion, paying for features offered in a product, not for the product itself is a fool's errand and in the long run it will fail even though at the beginning it showed potential.
Exactly. :)

One can argue that DLSS is better, but it's not so much better that paying extra for it would be a viable option, imo.

The other thing is that all upscaling is basically a crutch to help out with performance issues, unless you're targeting 4K + Ultra graphics. It's shouldn't be advertised as something extra to pay for.

Everything we discuss here is relevant for an end user. Especially the idea that if NV features advertised as hardware dependent are in fact not dependent. Which would mean these could be utilized by any card but instead are being blocked under the proclamation of hardware requirements not being met.
What I mean is that whether Nvidia artificially locked DLSS to RTX GPUs, or you really need Tensor cores to run it doesn't change the fact that you need an RTX card for DLSS, but you don't need a Radeon for FSR.

I very much agree with your notion that one should pay for performance, and not for features that we never even asked for in the first place.

On topic: CUDA is possibly a different cattle of fish, as some people use it for work, so paying for it kind of makes sense. I, on the other hand, don't work on my GPU, so I couldn't care less.
 
Joined
May 31, 2016
Messages
4,331 (1.49/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 16GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
On topic: CUDA is possibly a different cattle of fish, as some people use it for work, so paying for it kind of makes sense. I, on the other hand, don't work on my GPU, so I couldn't care less.
Yes you paid for it for work and yet you did not have to since CUDA can work on any graphics there is without the CUDA itself. It does not matter if it is for work or your own entertainment. I'm sure NV charged more for people who used CUDA for work and for gaming (if that would have been a thing) either way. They should not have because it can work on any card. That is my problem. It is like inventing a problem and and give a solution to it. You need CUDA for this and we give you CUDA. Then it turns out you dont need CUDA to run these apps with CUDA. Sole idea of what has been put on a plate with the CUDA thing is athrocious in my opinion. I would have felt screwed. That is why when I see advertisement like the one with RTX cards FG only on this DLSS3 only on that other feature only on this, is a worning for me not to go that way because it is made for only one puprose. Get money from someone for a feature that not necessarily is the way to go and could work on anything.
 
Joined
Jul 5, 2013
Messages
25,614 (6.46/day)
Yes you paid for it for work and yet you did not have to since CUDA can work on any graphics there is without the CUDA itself.
No. CUDA is a NVidia feature ONLY. No one who has paid for a non-Nvidia card has paid for CUDA. Full stop.
 
Joined
Jan 14, 2019
Messages
10,040 (5.15/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
Yes you paid for it for work and yet you did not have to since CUDA can work on any graphics there is without the CUDA itself. It does not matter if it is for work or your own entertainment. I'm sure NV charged more for people who used CUDA for work and for gaming (if that would have been a thing) either way. They should not have because it can work on any card. That is my problem. It is like inventing a problem and and give a solution to it. You need CUDA for this and we give you CUDA. Then it turns out you dont need CUDA to run these apps with CUDA. Sole idea of what has been put on a plate with the CUDA thing is athrocious in my opinion. I would have felt screwed. That is why when I see advertisement like the one with RTX cards FG only on this DLSS3 only on that other feature only on this, is a worning for me not to go that way because it is made for only one puprose. Get money from someone for a feature that not necessarily is the way to go and could work on anything.
I couldn't agree more. Unfortunately, it's a very Nvidia thing these days. That's why I'm not buying any of their cards as long as this practice continues.
 
Joined
Jan 14, 2019
Messages
10,040 (5.15/day)
Location
Midlands, UK
System Name Holiday Season Budget Computer (HSBC)
Processor AMD Ryzen 7 7700X
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 16 GB Corsair Vengeance EXPO DDR5-6000
Video Card(s) Sapphire Pulse Radeon RX 6500 XT 4 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
Wait, what? It's never not been an NVidia thing. Exclusively.
True, although most, if not all Nvidia features have been hardware-agnostic so far, with the exception of PhysX. It's only with the RTX moniker that they sped up the steep downhill roll on "buy our stuff or else" lane.
 
Top