Sunday, September 24th 2023

Run AI on Your PC? NVIDIA GeForce Users Are Ahead of the Curve

Generative AI is no longer just for tech giants. With GeForce, it's already at your fingertips. Gone are the days when AI was the domain of sprawling data centers or elite researchers. For GeForce RTX users, AI is now running on your PC. It's personal, enhancing every keystroke, every frame and every moment. Gamers are already enjoying the benefits of AI in over 300 RTX games. Meanwhile, content creators have access to over 100 RTX creative and design apps, with AI enhancing everything from video and photo editing to asset generation. And for GeForce enthusiasts, it's just the beginning. RTX is the platform for today and the accelerator that will power the AI of tomorrow.

How Did AI and Gaming Converge?
NVIDIA pioneered the integration of AI and gaming with DLSS, a technique that uses AI to generate pixels in video games automatically and which has increased frame rates by up to 4x. And with the recent introduction of DLSS 3.5, NVIDIA has enhanced the visual quality in some of the world's top titles, setting a new standard for visually richer and more immersive gameplay. But NVIDIA's AI integration doesn't stop there. Tools like RTX Remix empower game modders to remaster classic content using high-quality textures and materials generated by AI.
With NVIDIA ACE for Games, AI-powered avatars come to life on the PC, marking a new era of immersive gaming.


How Are RTX and AI Powering Creators?
Creators use AI to imagine new concepts, automate tedious tasks and create stunning works of art. They rely on RTX because it accelerates top creator applications, including the world's most popular photo editing, video editing, broadcast and 3D apps. With over 100 RTX apps now AI-enabled, creators can get more done and deliver incredible results.

The performance metrics are staggering. RTX GPUs boost AI image generation speeds in tools like Stable Diffusion by 4.5x compared to competing processors. Meanwhile, in 3D rendering, Blender experiences a speed increase of 5.4x.


Video editing in DaVinci Resolve powered by AI doubles its speed, and Adobe Photoshop's photo editing tasks become 3x as swift. NVIDIA RTX AI tech demonstrates a staggering 10x faster speeds in distinct workflows when juxtaposed against its competitors.

NVIDIA provides various AI tools, apps and software development kits designed specifically for creators. This includes exclusive offerings like NVIDIA Omniverse, OptiX Denoiser, NVIDIA Canvas, NVIDIA Broadcast and NVIDIA DLSS.

How Is AI Changing Our Digital Experience Beyond Chatbots?
Beyond gaming and content creation, RTX GPUs bring AI to all types of users. Add Microsoft to the equation and 100 million RTX-powered Windows 11 PCs and workstations are already AI-ready.
The complementary technologies behind the Windows platform and NVIDIA's dynamic AI hardware and software stack are the driving forces that power hundreds of Windows apps and games.
  • Gamers: RTX-accelerated AI has been adopted in more than 300 games, increasing frame rates and enhancing visual fidelity.
  • Creators: More than 100 AI-enabled creative applications benefit from RTX acceleration—including the top apps for image generation, video editing, photo editing and 3D. AI helps artists work faster, automate tedious tasks and expand the boundaries of creative expression.
  • Video Streamers: RTX Video Super Resolution uses AI to increase the resolution and improve the quality of streamed video, elevating the home video experience.
  • Office Workers and Students: Teleconferencing and remote learning get an RTX boost with NVIDIA Broadcast. AI improves video and audio quality and adds unique effects to make virtual interactions smoother and collaboration more efficient.
  • Developers: Thanks to NVIDIA's world-leading AI development platform and technology developed by Microsoft and NVIDIA called CUDA on Windows Subsystem for Linux, developers can now do early AI development and training from the comfort of Windows, and easily migrate to servers for large training runs.
What Are the Emerging AI Applications for RTX PCs?
Generative AI enables users to quickly generate new content based on a variety of inputs—text, images, sounds, animation, 3D models or other types of data—bringing easy-to-use AI to more PCs. Large language models (LLMs) are at the heart of many of these use cases.
Perhaps the best known is ChatGPT, a chatbot that runs in the cloud and one of the fastest growing applications in history.

Many of these LLMs now run directly on PC, enabling new end-user applications like automatically drafting documents and emails, summarizing web content, extracting insights from spreadsheet data, planning travel, and powering general-purpose AI assistants.

LLMs are some of the most demanding PC workloads, requiring a powerful AI accelerator—like an RTX GPU.

What Powers the AI Revolution on Our Desktops (and Beyond)?
What's fueling the PC AI revolution? Three pillars: lightning-fast graphics processing from GPUs, AI capabilities integral to GeForce and the omnipresent cloud. Gamers already know all about the parallel processing power of GPUs. But what role did the GPU play in enabling AI in the cloud? NVIDIA GPUs have transformed cloud services. These advanced systems power everything from voice recognition to autonomous factory operations.

In 2016, NVIDIA hand-delivered to OpenAI the first NVIDIA DGX AI supercomputer—the engine behind the LLM breakthrough powering ChatGPT. NVIDIA DGX supercomputers, packed with GPUs and used initially as an AI research instrument, are now running 24/7 at businesses worldwide to refine data and process AI. Half of all Fortune 100 companies have installed DGX AI supercomputers. The cloud, in turn, provides more than just vast quantities of training data for advanced AI models running on these machines.

Why Choose Desktop AI?
But why run AI on your desktop when the cloud seems limitless? GPU-equipped desktops—where the AI revolution began—are still where the action is.
  • Availability: Whether a gamer or a researcher, everyone needs tools—from games to sophisticated AI models used by wildlife researchers in the field—that can function even when offline.
  • Speed: Some applications need instantaneous results. Cloud latency doesn't always cut it.
  • Data size: Uploading and downloading large datasets from the cloud can be inefficient and cumbersome.
  • Privacy: Whether you're a Fortune 500 company or just editing family photos and videos, we all have data we want to keep close to home.
RTX GPUs are based on the same architecture that fuels NVIDIA's cloud performance. They blend the benefits of running AI locally with access to tools and the performance only NVIDIA can deliver.

NPUs, often called inference accelerators, are now finding their way into modern CPUs, highlighting the growing understanding of AI's critical role in every application. While NPUs are designed to offload light AI tasks, NVIDIA's GPUs stand unparalleled for demanding AI models with raw performance ranging from a 20x-100x increase.

What's Next for AI in Our Everyday Lives?
AI isn't just a trend—it will impact many aspects of our daily lives. AI functionality will expand as research advances and user expectations will evolve. Keeping up will require GPUs—and a rich software stack built on top of them—that are up to the challenge.

NVIDIA is at the forefront of this transformative era, offering end-to-end optimized development solutions.

NVIDIA provides developers with tools to add more AI features to PCs, enhancing value for users, all powered by RTX.

From gaming innovations with RTX Remix to the NVIDIA NeMo LLM language model for assisting coders, the AI landscape on the PC is rich and expanding.

Whether it's stunning new gaming content, AI avatars, incredible tools for creators or the next generation of digital assistants, the promise of AI-powered experiences will continuously redefine the standard of personal computing.

Learn more about GeForce's AI capabilities.
Source: NVIDIA Blog
Add your own comment

46 Comments on Run AI on Your PC? NVIDIA GeForce Users Are Ahead of the Curve

#1
Verpal
I love AI, love LLM, but this is just cringe.

If NVIDIA really want to push AI forward, give us sufficient VRAM for each tier of GPU, no matter what optimization you do, if model doesn't fit in VRAM it will run like crap.
Posted on Reply
#2
TheoneandonlyMrK
Ai , It's personal, enhancing every keystroke, every frame and every moment.

Is it now, Cortana say's Hi.
Posted on Reply
#3
ZoneDymo
" For GeForce RTX users, AI is now running on your PC. It's personal, enhancing every keystroke, every frame and every moment"

sounds...oddly threatening tbh

also that vidoe with the ai answers...I dont even know where to start, it is so stupid, it is so vague....it just awful.
Posted on Reply
#4
Frick
Fishfaced Nincompoop
So Nvidia just released a press release saying "AI is awesome and we're the best at it" and nothing else?
Posted on Reply
#5
ZoneDymo
FrickSo Nvidia just released a press release saying "AI is awesome and we're the best at it" and nothing else?
yep and TPU'd relayed it just for you, you are welcome
Posted on Reply
#6
TumbleGeorge
VerpalI love AI, love LLM, but this is just cringe.

If NVIDIA really want to push AI forward, give us sufficient VRAM for each tier of GPU, no matter what optimization you do, if model doesn't fit in VRAM it will run like crap.
I doubt that loading the entire model into VRAM would significantly improve process. There are quite a few operations that use the CPU. And it works mainly with RAM. Of course, Resizable BAR has been around for many years, but the speed of information exchange is limited to the throughput of the PCIe standard anyway. Even the fastest available today with version 5.0, is no faster than CPU to RAM communication.
Posted on Reply
#7
Shihab
FrickSo Nvidia just released a press release saying "AI is awesome and we're the best at it" and nothing else?
Marketing department has to justify its existence somehow...
Posted on Reply
#8
Daven
No Nvidia, I don’t want leatherware in my PC. Please leave me alone.
Posted on Reply
#9
john_
Conclusion.
Now you know why 4000 series is expensive and why 5000 will be even more expensive.


All cheer for Nvidia. They push gaming and AI forward, no one denies this, but with proprietary techs that will hit our wallets in the future (and today).
VerpalIf NVIDIA really want to push AI forward, give us sufficient VRAM for each tier of GPU, no matter what optimization you do, if model doesn't fit in VRAM it will run like crap.
You know that. Me, I suspect it from what little I read. Others don't. Others will just rush to buy an RTX 4060 or an RTX 4070 to play with AI.
They will ask their friends with knowledge latter "I bought the correct model, right? It does say Nvidia.".
Posted on Reply
#10
ARF
DavenNo Nvidia, I don’t want leatherware in my PC. Please leave me alone.
Me neither, I don't want nvidia's shenanigans, that's why I use AMD Radeon only.

Artificial intelligence doesn't exist. They must be sued / global class-action lawsuit for inventing new crazy phrases, for misleading the customers, nonsense and trolling hard.
It's like saying that a stone can become intelligent, or that your dog can become a genius...

No, humans are needed to input some data/information which is then used for certain tasks...
I don't even know how it can be "accelerated". It can't.
Posted on Reply
#11
Daven
ARFMe neither, I don't want nvidia's shenanigans, that's why I use AMD Radeon only.

Artificial intelligence doesn't exist. They must be sued / global class-action lawsuit for inventing new crazy phrases, for misleading the customers, nonsense and trolling hard.
It's like saying that a stone can become intelligent, or that your dog can become a genius...

No, humans are needed to input some data/information which is then used for certain tasks...
I don't even know how it can be "accelerated". It can't.
All games should require CUDA, AI, DLSS, RT, Gysnc and a subscription to Geforce now. It’s time for a 100% Nvidia monopoly!

/sarcasm

But in all seriousness, I agree with you and I’m enjoying every minute of my Radeon 7900XT.
Posted on Reply
#12
Vayra86
You all know the best deal is one you can't refuse right... Nvidia is slowly shaping their ecosystem to make it happen.

The more you buy the more you save yourself from having choices in the future ;) Keep at it bois
Posted on Reply
#13
agent_x007
Not sure why post this as news (NV wants everyone to know it does stuff that sounds good and is profitable) ?
Bunch of slogans that are meant to sound good so that You buy that next thing they do.
To be honest, I already am tired of all AI NV keeps pushing... yes, it's nice, yes looks great, yes it's fast(er) than competition, etc.

But can't NV make it cheaper ?
Until they (NV) figure out that low power = cheap(er) building materials* I think I will stay on the side of RTX thing with my "useless" Titan V (as Tensor cores in it are too stupid to do "AI" features NV keeps throwing at me).

PS. *or does ASUS/Gigabyte/ASRock/MSI, need to say to NV they want to make lower power things but they can't because NV spec's forced frequency/power/voltage limits ?
Posted on Reply
#14
john_
agent_x007But can't NV make it cheaper ?
No, but they can make it pricier. And as @Vayra86 points above, when those proprietary techs become mandatory, no one will have the option to refuse it. Except those who will abandon AAA titles or accept having a subpar experience while paying the full price.
agent_x007Not sure why post this as news
Press release. Sunday, no news...
Posted on Reply
#17
Sabotaged_Enigma
Screw you Nvidia. The world probably lives as it should without AI, but the world would DEFINITELY lives on quite well without Nvidia.
Idk man. Now I've come to the point where I wanna slam that face every time I see leatherman Huang.
Posted on Reply
#18
TheoneandonlyMrK
Artificial Innovation, that's what I have been seeing.
Within two years the hardware you bought now won't be up to the task, because they're iterating software so fast, all for a reason, meanwhile to maintain pricing they cut production.

So you buy into they're tech and within two years they're telling you , that you need to spend 2k to game right.

I bought into it once, at least, that'll do..
Posted on Reply
#19
R-T-B
TumbleGeorgeHmm, ROCm 5.7 was released before few days. I didn't see article for that in TPU news channel. Is there good changes?
That's because ROCm is mostly applicable to linux IIRC. It wouldn't be an incredibly newsworthy moment for most.
Posted on Reply
#20
agent_x007
john_No, but they can make it pricier. And as @Vayra86 points above, when those proprietary techs become mandatory, no one will have the option to refuse it. Except those who will abandon AAA titles or accept having a subpar experience while paying the full price.
There is no way for any type of super sampling or anti-aliasing ever to become mandatory for desktop GPU :D

Native resolution is there for a reason, and that is because it tells how much pixels a monitor can display.
Because of this, ALL VSR/DSR/AAs/SSs/DLs/etc. options are lower quality vs. simply higher native resolution.
Unless, you want to tell me that a 1080p monitor with all those AAs/SSs/DLLness has image quality as 1440p/4k screen :) (I assume here, same panel quality, same refresh rate, same HDR support between all monitors)

"Features" enhance image quality on the same monitor, so it may look closer to higher native resolution one.
They will never replace it.

Unless you talking about Tensors doing AI stuff for games (like that NPC example), which only makes things more confusing to me, as that is not open standard. So, until CPUs or AMD GPUs are able to do it - this tech will also never get "mandatory". Many other things (example : PhysX, Mantle, Tessellation), were presumed to be "the future" and all died or get open sourced before getting wide spread.
Posted on Reply
#21
DemonicRyzen666
Well If's A.I. is so smart how came it still has shimmering in a lot the games when it's use? Shouldn't it have figured out that it's never supposed to be there by now?
You can polish a turd all you want, make it looks shinny & what not but it's still just a turd.
Posted on Reply
#22
AusWolf
ZoneDymo" For GeForce RTX users, AI is now running on your PC. It's personal, enhancing every keystroke, every frame and every moment"

sounds...oddly threatening tbh

also that vidoe with the ai answers...I dont even know where to start, it is so stupid, it is so vague....it just awful.
Agreed. This push for AI is pure cringe.
Posted on Reply
#23
Tom Yum
Ergh, TPU could do without these sort of press releases. I get the need (advertising revenue plus OEM relationships), and press releases that tell us about a product launch or something can be moderately useful, but this press release:

1) Tells us absolutely nothing, and
2) Honestly feels like NVIDIA is jerking off in my face, while telling me I should be happy about it.

Now excuse me while I go wash NVIDIA jizz marketing off me.
Posted on Reply
#24
zlobby
We are one middle-out compression algorithm and Son of Anton will nuke us all!

For real - eff nvidia!
R-T-BThat's because ROCm is mostly applicable to linux IIRC. It wouldn't be an incredibly newsworthy moment for most.
Yeah, and this is how?
Posted on Reply
#25
R-T-B
zlobbyYeah, and this is how?
ROCm generally is used to get OpenCL working on linux. I don't think you need it to get OpenCL on windows, the standard drivers do that.

Other than that: This is as newsworthy as any press release from AMD or elsewhere. It is tagged as such you know.


Saying a press release is full of PR spin is like saying water is wet.
Posted on Reply
Add your own comment
May 16th, 2024 01:45 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts