Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Distortion Issues in video2world Model During Image-to-Video Testing #72

Open
lith0613 opened this issue Jan 21, 2025 · 1 comment
Open
Assignees
Labels
question Further information is requested

Comments

@lith0613
Copy link

I attempted to use the video2world model to test the image-to-video generation feature. According to the project’s readme file, the model should support multiple resolutions and aspect ratios, including 1:1 (960x960), 4:3 (960x704), 3:4 (704x960), 16:9 (1280x704), and 9:16 (704x1280).

However, during the actual testing process, I found that only at the aspect ratio of 9:16 (704x1280) did the generated video quality appear relatively normal. At other ratios, the videos exhibited significant distortions and artifacts. I followed the scripts provided in the readme file precisely.

I would like to inquire if this situation is expected. If there were any errors in my operation or improper configuration, please advise on the correct usage. If not, is there a solution or planned fix for this issue?

Looking forward to your response, thank you!

@zlenyk
Copy link

zlenyk commented Jan 21, 2025

Could you point out where in Readme did you see that? So far I noticed that the only resolution that is accepted by video2world model is 1024x640. Anything else needed changes to the code and produced bad outputs

@sophiahhuang sophiahhuang added the question Further information is requested label Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants