FFmpeg sr filter speed

[sonicdebris]

Hello,I managed to generate a model for the srcnn filter from the checkpoints, and tried to use it to process a video with ffmpeg, with this command:

ffmpeg -i input.3gp -vf sr=model=/path/to/srcnn.model:scale_factor=2 upscaled.avi

The processing speed ~2 fps for a 176x144px video. I am on a 16-thread, 4GHz machine. Is that expected?

[Witiko]

You are using the single-threaded native ffmpeg implementation, which is slow. By compiling ffmpeg with the --enable-tensorflow option and converting with the sr=[…]:dnn_backend=tensorflow option, you can use the tensorflow library instead, which can use all your CPU cores or a GPU. On my machine, I am seeing around 8 fps when using 4 CPU cores and around 15 fps when using a GPU.