-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
video captioning tool #1593
base: main
Are you sure you want to change the base?
video captioning tool #1593
Conversation
phi/tools/video.py
Outdated
video = VideoFileClip(video_path) | ||
video.audio.write_audiofile(output_path) | ||
print(f"Audio extracted to {output_path}") | ||
return output_path |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Return the full string that you logged
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Add setup steps to install ffmpeg
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we not have this video? Let's have some normal video
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
on it
# Create temp directory if it doesn't exist | ||
temp_dir = Path("/tmp/video_captions") | ||
temp_dir.mkdir(parents=True, exist_ok=True) | ||
|
||
|
||
video_caption_agent.print_response( | ||
"Generate captions for cookbook/examples/caption_video_tool/trump.mp4 and embed them in the video" | ||
) | ||
# video_caption_agent.print_response( | ||
# "read the captions for /Users/ayushjha/Downloads/videoplayback (1).mp4 and summarize them" | ||
# ) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The video doesn't get created in the tmp folder but instead in the same examples folder. We also need to move that video from examples folder
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
on it
Description
Please include:
Fixes # (issue)
Type of change
Please check the options that are relevant:
Checklist
Additional Notes
Include any deployment notes, performance implications, or other relevant information: