Tuesday, September 1st 2026

NVIDIA GPU Frame Interpolation Support Lands in FFmpeg

NVIDIA's GPU-accelerated frame interpolation support has been integrated into FFmpeg through a Vulkan API, as announced by the project's developers. For those unfamiliar, FFmpeg is a widely used software suite that powers much of the world's modern multimedia processing, including platforms like YouTube and many other services and applications. This tool now leverages NVIDIA GeForce RTX GPUs to predict and generate the next frame without involving the traditional graphics rendering pipeline. NVIDIA is extending this capability to video encoding, allowing users to increase the frame rate of their videos through frame generation technology. The Optical Flow Accelerator (NVOFA) in NVIDIA GPUs applies the same Optical Flow logic used in graphics rendering to videos, predicting the next frame and enhancing frame rates through AI-generated frames. NVIDIA calls this process Engine-assisted Frame-rate Up Conversion (FRUC).

FRUC is more than a conventional frame-smoothing algorithm, as it uses NVIDIA's dedicated Optical Flow Accelerator to calculate motion between consecutive source frames. NVENC provides the encoder-side frame data, while the optical flow hardware generates motion vectors that describe how objects move between frames. FFmpeg can then use that motion information to synthesize an intermediate frame, effectively increasing the video's frame rate without re-rendering the original content. This is also more efficient than software-based interpolation, which can place significantly higher computational demands on the CPU. The new Vulkan implementation gives FFmpeg direct access to the NVIDIA hardware while avoiding the proprietary software dependency that prevented the earlier 2023 patch from being merged.
The Optical Flow Accelerator was originally introduced during the era of NVIDIA's GeForce RTX 20-Series "Turing." However, this Vulkan API-based implementation officially supports only NVIDIA's GeForce RTX 30-Series "Ampere" and newer. This means that owners of the GeForce RTX 30, RTX 40, and RTX 50 series can benefit from the new feature. Video frame rates will now be doubled, allowing 30 FPS videos to be displayed at 60 FPS, and cinematic 24 FPS videos to be shown at 48 FPS with GPU-assisted frame interpolation. To take advantage of this, you simply need to run the FFmpeg tool on your end.
Sources: Phoronix, via VideoCardz
Add your own comment

12 Comments on NVIDIA GPU Frame Interpolation Support Lands in FFmpeg

#1
TumbleGeorge
Hmm, does this mean that in the future I won't even be able to watch YouTube without it being a slideshow if I don't have modern hardware with dlss?
Posted on Reply
#2
chrcoluk
TumbleGeorgeHmm, does this mean that in the future I won't even be able to watch YouTube without it being a slideshow if I don't have modern hardware with dlss?
Ironically its recently been found out a RTX super resolution feature in Firefox has been significantly slowing down scrolling when media is playing. The dev's are utterly silent on the issue, features over performance.

So yeah I wouldnt say its impossible for what you say to be the future.
Posted on Reply
#3
Prima.Vera
The TV's are doing this for decades??
Posted on Reply
#4
AleksandarK
News Editor
Prima.VeraThe TV's are doing this for decades??
TVs dont use motion vectors to get precise outputs ;)
Posted on Reply
#5
JoeTheDestroyer
AleksandarKTVs dont use motion vectors to get precise outputs ;)
Of course they do. Optic flow is an ancient technique, and an obvious one for this task.

The big deal with DLSS is that it didn't need to rely upon optic flow (which has many flaws) because it could source motion vectors straight from the graphics engine.
Posted on Reply
#6
Steevo
AleksandarKTVs dont use motion vectors to get precise outputs ;)
en.wikipedia.org/wiki/Motion_interpolation

I was using vector motion and interpolation frame generation since the 2000's

Then it started being sold with things like PowerDVD, before that there were codec packs that would enable it, and AMD had the feature for 24FPS content up/down sampling on some of their AIW products that was exposed in their driver control or by third party software. hothardware.com/reviews/ati-allinwonder-hd I used a tuner card and could play GTA4 on one screen with audio output while the wife watched TV on the big screen in the living room while it was also recording another show, or watch Netflix or Hulu right through Windows Media Center.

They just removed it all and are now selling it back to us as "improvements".
Posted on Reply
#7
Freedom4556
Aside from the DLSS / AI frame gen hate, enthusiasts already despise the so-called "Soap Opera effect" that's been in TVs for over a decade. There's no chance this won't get widely panned.
Posted on Reply
#8
igormp
JoeTheDestroyerThe big deal with DLSS is that it didn't need to rely upon optic flow (which has many flaws) because it could source motion vectors straight from the graphics engine.
DLSS FG actually relied on the internal optic flow accelerator on its first versions:
DLSS 3 adds Optical Multi Frame Generation to generate entirely new frames, and integrates NVIDIA Reflex low latency technology for optimal responsiveness. DLSS 3 is powered by the new fourth-generation Tensor Cores and Optical Flow Accelerator of the NVIDIA Ada Lovelace architecture, which powers GeForce RTX 40 Series graphics cards.

The DLSS Frame Generation convolutional autoencoder takes 4 inputs – current and prior game frames, an optical flow field generated by Ada’s Optical Flow Accelerator, and game engine data such as motion vectors and depth.
www.nvidia.com/en-us/geforce/news/dlss3-ai-powered-neural-graphics-innovations/

But later versions dropped this need iirc (not sure if it was 3.5 or 4).
Posted on Reply
#9
chrcoluk
My parents TV uses interpolation for media, and watching movies at 60fps feels way off, the immersion is gone and its like I am watching a TV soap.
Posted on Reply
#10
ZeDestructor
I'm willing to give it a try. Worst case I hate it like I hate the shitty TV ones and go back to no interpolation, but if it's good enough it will be very nice to no longer live under the tyranny of 23.976fps.
Posted on Reply
#11
Prima.Vera
ZeDestructorthe tyranny of 23.976fps.
No. For movies is perfect. Even 30fps is way to much, since it start to look like a live action. That's why ALL of the TV show recorded at 30fps look and feel like crap.
Posted on Reply
#12
ZeDestructor
Prima.VeraNo. For movies is perfect. Even 30fps is way to much, since it start to look like a live action. That's why ALL of the TV show recorded at 30fps look and feel like crap.
Yeah, nah, very much not for me.

Remember when The Hobbit part 1 was available in 48fps through being shot at 48fps? I went for one of the 48fps screenings specifically to see what was up with the 48fps (since the movie itself was not very good, and critics were panning the 48fps-ness of it), and my experience was that after about 20 minutes or so of feeling weird, it just felt perfectly normal.

The actual problem I had with that 48fps screening did not hit until I was back home from the theater: for weeks afterwards every 23-30fps movie, TV show or animated media felt like a late PS3-era blurry, laggy, stuttery mess.
Posted on Reply
Add your own comment
Nov 21st, 2026 02:35 PST change timezone

New Forum Posts

Popular Reviews

TPU on YouTube

Controversial News Posts