Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is Intel VPL AI-Powered Video Frame Interpolation in ffmpeg? #364

Open
Usulyre opened this issue Jan 21, 2025 · 9 comments
Open

Is Intel VPL AI-Powered Video Frame Interpolation in ffmpeg? #364

Usulyre opened this issue Jan 21, 2025 · 9 comments

Comments

@Usulyre
Copy link

Usulyre commented Jan 21, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

I have an intel core i3 1215u processor, can the integrated graphics work with this? Or do I need something like a better intel cpu or Intel ARC gpu?

If it is in the ffmpeg filter, what is an example cmdline to use the VPL AI frame interpolation?

And can ffplay utilize it as well, for realtime playback of video?

I'm using windows 11 .

@feiwan1
Copy link
Contributor

feiwan1 commented Jan 23, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

@Usulyre
Copy link
Author

Usulyre commented Jan 28, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Does the regular frame interpolation work ? Intel one?

With ffplay, is there an example? I tried it but i keep getting errors about sizing..

@feiwan1
Copy link
Contributor

feiwan1 commented Feb 5, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Yes.

Does the regular frame interpolation work ? Intel one?

With ffplay, is there an example? I tried it but i keep getting errors about sizing..

You may use "vpp_qsv=framerate=xx" filter for qsv frame interpolation. An example:

$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -i in.mp4 -vf "vpp_qsv=framerate=60" -pix_fmt yuv420p -f nut - | ffplay -

@Usulyre
Copy link
Author

Usulyre commented Feb 5, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Yes.

Does the regular frame interpolation work ? Intel one?
With ffplay, is there an example? I tried it but i keep getting errors about sizing..

You may use "vpp_qsv=framerate=xx" filter for qsv frame interpolation. An example:

$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -i in.mp4 -vf "vpp_qsv=framerate=60" -pix_fmt yuv420p -f nut - | ffplay -

Ok will try that, but does it work with ffplay by itself?

If so, can you provide an example, would like to use it for realtime playback of a video.

I would also like to use it in mpv video player.

@feiwan1
Copy link
Contributor

feiwan1 commented Feb 5, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Yes.

Does the regular frame interpolation work ? Intel one?
With ffplay, is there an example? I tried it but i keep getting errors about sizing..

You may use "vpp_qsv=framerate=xx" filter for qsv frame interpolation. An example:
$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -i in.mp4 -vf "vpp_qsv=framerate=60" -pix_fmt yuv420p -f nut - | ffplay -

Ok will try that, but does it work with ffplay by itself?

No, ffplay doesn't support QSV hwaccel. YUV dump is needed to use ffplay.

If so, can you provide an example, would like to use it for realtime playback of a video.

I would also like to use it in mpv video player.

@Usulyre
Copy link
Author

Usulyre commented Feb 5, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Yes.

Does the regular frame interpolation work ? Intel one?
With ffplay, is there an example? I tried it but i keep getting errors about sizing..

You may use "vpp_qsv=framerate=xx" filter for qsv frame interpolation. An example:
$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -i in.mp4 -vf "vpp_qsv=framerate=60" -pix_fmt yuv420p -f nut - | ffplay -

Ok will try that, but does it work with ffplay by itself?

No, ffplay doesn't support QSV hwaccel. YUV dump is needed to use ffplay.

If so, can you provide an example, would like to use it for realtime playback of a video.
I would also like to use it in mpv video player.

Ok.

Do you happen to know how to use it mpv video player?

@feiwan1
Copy link
Contributor

feiwan1 commented Feb 5, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Yes.

Does the regular frame interpolation work ? Intel one?
With ffplay, is there an example? I tried it but i keep getting errors about sizing..

You may use "vpp_qsv=framerate=xx" filter for qsv frame interpolation. An example:
$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -i in.mp4 -vf "vpp_qsv=framerate=60" -pix_fmt yuv420p -f nut - | ffplay -

Ok will try that, but does it work with ffplay by itself?

No, ffplay doesn't support QSV hwaccel. YUV dump is needed to use ffplay.

If so, can you provide an example, would like to use it for realtime playback of a video.
I would also like to use it in mpv video player.

Ok.

Do you happen to know how to use it mpv video player?

Kindly remember that mpv didn't support QSV. You may confirm with MPV members.

@Usulyre
Copy link
Author

Usulyre commented Feb 6, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Yes.

Does the regular frame interpolation work ? Intel one?
With ffplay, is there an example? I tried it but i keep getting errors about sizing..

You may use "vpp_qsv=framerate=xx" filter for qsv frame interpolation. An example:
$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -i in.mp4 -vf "vpp_qsv=framerate=60" -pix_fmt yuv420p -f nut - | ffplay -

Ok will try that, but does it work with ffplay by itself?

No, ffplay doesn't support QSV hwaccel. YUV dump is needed to use ffplay.

If so, can you provide an example, would like to use it for realtime playback of a video.
I would also like to use it in mpv video player.

Ok.
Do you happen to know how to use it mpv video player?

Kindly remember that mpv didn't support QSV. You may confirm with MPV members.

This works for mpv for me:

ffmpeg.exe -hwaccel qsv -hwaccel_output_format qsv -i 1.avi -vf "vpp_qsv=framerate=120" -pix_fmt yuv420p -f mpegts - | mpv -

Are there any other options/parameters for vpp_qsv=framerate ?

@feiwan1
Copy link
Contributor

feiwan1 commented Feb 6, 2025

Has Intel VPL AI video frame interpolation been integrated into ffmpeg vpp_qsv filter yet?

No, ffmpeg doesn't support AI interpolation.

You mean it hasn't been integrated yet?

Yes.

Does the regular frame interpolation work ? Intel one?
With ffplay, is there an example? I tried it but i keep getting errors about sizing..

You may use "vpp_qsv=framerate=xx" filter for qsv frame interpolation. An example:
$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -i in.mp4 -vf "vpp_qsv=framerate=60" -pix_fmt yuv420p -f nut - | ffplay -

Ok will try that, but does it work with ffplay by itself?

No, ffplay doesn't support QSV hwaccel. YUV dump is needed to use ffplay.

If so, can you provide an example, would like to use it for realtime playback of a video.
I would also like to use it in mpv video player.

Ok.
Do you happen to know how to use it mpv video player?

Kindly remember that mpv didn't support QSV. You may confirm with MPV members.

This works for mpv for me:

ffmpeg.exe -hwaccel qsv -hwaccel_output_format qsv -i 1.avi -vf "vpp_qsv=framerate=120" -pix_fmt yuv420p -f mpegts - | mpv -

Ok, this encode the output to mpegts by ffmpeg, then use mpv to play mpegts stream. I was thinking to use mpv to play a stream directly and call for QSV.

Are there any other options/parameters for vpp_qsv=framerate ?

No. You can check all parameters by using 'ffmpeg -h filter=vpp_qsv'.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants