FFmpeg Gets AMD AMF Accelerated Decoding Support, FSR Video Super Resolution Upscaler

[btarunr]

FFmpeg, the popular open-source multimedia library for compressed video and audio formats, just introduced a component to libavcodec that integrates AMD Accelerated Media Framework (AMF) SDK. This component is called AMFDEC, and it allows libavcodec to utilize hardware-accelerated decoding features on AMD Radeon RX GPUs and the integrated graphics of AMD Ryzen processors. On machines with compatible hardware, AMFDEC provides libavcodec with hardware acceleration for decoding of H.264, H.265 or HEVC, and AV1. FFmpeg also introduced filters that implement AMD FSR Video Super Resolution. This lets applications that use FFmpeg to take advantage of VSR features on Radeon RX GPUs to provide superior upscaling quality. The filter is labelled "ar_amf." The commit can be accessed here.



View at TechPowerUp Main Site | Source

 

[RaphaelOne]

Well, it's about time. I'm especially happy about the support for VSR for real-time scaling.

 

[Gigaherz]

Throw Ai in the Bin! This is the kind of tech advancement we need. Comprehensible and with an actual practical benefit.

 

[btarunr]

Throw Ai in the Bin! This is the kind of tech advancement we need. Comprehensible and with an actual practical benefit.

Neither AMF nor VSR have anything to do with AI.

 

[DaemonForce]

This sounds HUGE.

avutil: add hwcontext_amf.

Adds hwcontext_amf, enabling a shared AMF context for encoders,
decoders, and AMF-based filters, without copy to the host memory.
Code also was tested in HandBrake.

Benefits:
- Optimizations for direct video memory access from CPU
- Significant performance boost in full AMF pipelines with filters
- Integration of GPU filters like VPP, Super Resolution, and
Compression Artefact Removal(in future plans)
- VCN power management control for decoders.
- Ability to specify which VCN instance to use for decoding
(like for encoder)
- AMD will soon introduce full AMF API for multimedia accelerator MA35D
- With AMF API, integration will be much easier:
GPU and the accelerator will have the same API
- including encoder, decoder, scaler, color converter,
Windows and Linux.
Learn more:
https://www.amd.com/en/products/accelerators/alveo/ma35d.html

Changes by versions:
v2: Header file cleanup.
v3: Removed an unnecessary class.
v4: code cleanup and improved error handling
v5: Fixes related to HandBrake integration.
v6: Sequential filters error and memory leak have been fixed.

Looks like the kind of update that stirs a serious change, especially since it impacts h.264 and h.265.

 

[ZoneDymo]

Neither AMF nor VSR have anything to do with AI.

I dont think that matters for the statement they are making, they are throwing under the umbrella of "tech advancements" and claim that unlike AI this has a use case and is defined, which is why more money and resources should go to this whether then AI.

 

[Vayra86]

Advanced Motherf^(%_@#! Frames!

I just can't unread that anymore when I read AMF. It happened already when they coined the term...
Same with MFG. Poor choices honestly

 

[Divide Overflow]

It would be interesting to see some test results to compare the improvements this brings.

 

[Punkenjoy]

If AMD want to become a leader, they need to continue these software initiatives. They are so late behind both Intel and Nvidia.

And for Software, there is no TSMC that can come and save their ass.

The good thing is it seem they got the Memo, but it will take few years.

 

[Clawedge]

What about frame interpolation?

 

[Visible Noise]

Throw Ai in the Bin! This is the kind of tech advancement we need. Comprehensible and with an actual practical benefit.

 

[Nhonho]

It would be nice if the group that maintains the "K-Lite codec pack" implemented this in MPC-HC with MADVR.

 

[Bruno_O]

" On machines with compatible hardware, AMFDEC provides libavcodec with hardware acceleration for decoding of H.264, H.265 or HEVC, and AV1"

Pardon my ignorance, but I have HW decode on my RDNA3 GPU for h264/265 and AV1 since I bought it when it was released. I use LAV filters, "ffmpeg based DirectShow Splitter and Decoders", plus MPC.

So not entirely sure what this update brings... new features?

 

[DaemonForce]

If you're not using FFmpeg in anything, what are you doingdon't worry about it.
Odds are you're not even using any of those features until you pull up YT/Twitch.
While I question your financial literacy in that, it just means more better for the rest of us.

 

[Steevo]

" On machines with compatible hardware, AMFDEC provides libavcodec with hardware acceleration for decoding of H.264, H.265 or HEVC, and AV1"

Pardon my ignorance, but I have HW decode on my RDNA3 GPU for h264/265 and AV1 since I bought it when it was released. I use LAV filters, "ffmpeg based DirectShow Splitter and Decoders", plus MPC.

So not entirely sure what this update brings... new features?

Reimplementation of features that Cyber DVD and ATi offered with a fancy new name.

Upscaling and frame interpolation based on motion vector was a thing since early
2000s now it just supports new codecs like 265/mkv/AV1 but then again my Canon HD camera was shooting in MKV when the only codec that was useable was the one that came on its software disk.