Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

if subtitles is None model gives an error .... how to infere without subtitles? #40

Open
Mohand995 opened this issue Oct 21, 2024 · 2 comments

Comments

@Mohand995
Copy link

No description provided.

@rajendrac3
Copy link

rajendrac3 commented Oct 25, 2024

In generate_prediction() function in minigpt4_video_inference.py file, instead of if gen_subtitles change it to if not gen_subtitles:
This will download openai's whisper model and generate subtitles.

@amansahu278
Copy link

You could also pass subtitles as an empty list to match_frames_and_subtitles, inside the prepare_input method, in minigpt4_video_inference.py
Make sure to comment out the call to extract_subtitles since that fails for subtitle_path=None
The above changes would reduce the model to working only with the image frames.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants