Remove FFMPEG dependency and use GStreamer instead

[dabrain34]

I'm planning to add GStreamer capabilities to replace the FFMpeg parser in

vk_video_samples/vk_video_decoder/demos/vk-video-dec/AppDecVulkanFrame/VulkanVideoProcessor.cpp

Line 49 in de54a1d

m_pFFmpegDemuxer = new FFmpegDemuxer(filePath);

Do you prefer an option and keep FFMpeg or just like drop FFMpeg for real ?

[dabrain34]

See #21

[zlatinski]

Do you prefer an option and keep FFMpeg or just like drop FFMpeg for real ?

I would still like to keep the FFMPEG as an option, please, since we still use it as video demuxer with the NV parser.

[dabrain34]

no problem at all to keep the 2. Its just it would be easier to have one library for all.

[BattleAxeVR]

I was looking into GStreamer and it seems like a good alternative to FFMPEG, so I would like to see this PR merged to the main branch at some point too. Anyway the main branch doesn't even work at all right now

[dabrain34]

We could also use https://github.com/Igalia/ESExtractor

[BattleAxeVR]

I would kill to find a video decoder that can also output the motion vectors. That's super useful for using video streams in videogames, if you're using things like DLSS. FFMPEG CPU decoder is supposed to have such a feature but that was ages ago I don't think was ever merged.

[zlatinski]

Hi @BattleAxeVR, Can you please try https://developer.nvidia.com/optical-flow-sdk? We are still considering a Vulkan video extension that will output the motion vectors, but I'm not sure if this extension will be done this year.

[BattleAxeVR]

Thanks for the tip, I noticed that project a while back and how it would be suitable, however I've already implemented a working pipeline for vulkan video with explicit MVs stored in a separate video file.

I mostly needed the MVs as inputs to DLSS, which I've discovered can be exploited to produce some rather neat special FX like mirages or optical lensing / hot air shimmering the scene behind it: