AMD contributes ONNX Runtime backend to FFmpeg DNN filter
Summary
An AMD engineer contributed an ONNX Runtime backend to FFmpeg's DNN filter, enabling AI model inference on GPU and NPU platforms for tasks like upscaling and object detection, notably making Ryzen AI NPU useful for FFmpeg.
View Cached Full Text
Cached at: 06/25/26, 01:21 PM
AMD Contributes ONNX Runtime Backend To FFmpeg DNN Filter
Source: https://www.phoronix.com/news/FFmpeg-DNN-ONNX-Runtime
An AMD engineer has contributed to the upstream FFmpeg library an ONNX Runtime back-end for its DNN filter. The FFmpeg Deep Neural Network (DNN) filters allow for running AI models natively inside the video processing pipeline for upscaling, object detection, background segmentation, and more. This ONNX Runntime back-end support is notable in that it expands the GPU and NPU capabilities with FFmpeg.
AMD engineer Steven Xiao authored the ONNX Runtime back-end for FFmpeg’s DNN processing filter. This addition opens up FFmpeg DNN to supporting inferencing on multiple GPU and NPU platforms. Beyond the CPU execution, there is NVIDIA CUDA support, Windows DirectML execution across all the major GPU vendors, and also AMD Ryzen AI NPU support across platforms using the ONNX Runtime VitisAI execution provider. The main takeaway is AMD beginning to make the Ryzen AI NPU useful for FFmpeg.
Those interested can learn more about this ONNX runtime back-end for the FFmpeg DNN filter viathis commit.
Similar Articles
AMD's tiny AI PC points to a more local future for model inference
AMD's Ryzen AI Max platform with 128GB unified memory enables local inference of large models up to 200 billion parameters, aiming to shift AI workloads from cloud to compact personal hardware.
AMD's Lemonade SDK for local AI adds NVIDIA CUDA support
AMD's Lemonade SDK for local AI adds NVIDIA CUDA support in version 10.7, enabling the same local AI server experience on competitor GPUs. The release also introduces lemonade bench for cross-backend LLM benchmarking and broader Vulkan support.
Big News for AMD / Strix Halo+ Owners
The NPU on AMD Strix Halo devices is now usable for AI inference, enabling hybrid mode that combines NPU and iGPU for faster prompt processing. Tools like Lemonade and AMD's ROCm software make this possible.
AMD Powers Next-Generation Agent Computers with New Ryzen AI Halo Developer Platform and Ryzen AI Max PRO 400 Series Processors
AMD announces the Ryzen AI Halo developer platform for local AI development, capable of running models up to 200B parameters, and the Ryzen AI Max PRO 400 Series processors for commercial AI PCs, enabling agentic AI workloads locally.
AMD touts the unified memory architecture
AMD touts unified memory architecture as a key enabler for next-gen products like the Ryzen AI MAX 400 series (Gorgon Halo), shaping their product roadmaps for AI and compute workloads.