You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In generate_prediction() function in minigpt4_video_inference.py file, instead of if gen_subtitles change it to if not gen_subtitles:
This will download openai's whisper model and generate subtitles.
You could also pass subtitles as an empty list to match_frames_and_subtitles, inside the prepare_input method, in minigpt4_video_inference.py
Make sure to comment out the call to extract_subtitles since that fails for subtitle_path=None
The above changes would reduce the model to working only with the image frames.
No description provided.
The text was updated successfully, but these errors were encountered: