Skip to content

base conv_mode for /scripts/eval/mme.sh #172

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
bastian1209 opened this issue Mar 5, 2025 · 1 comment
Open

base conv_mode for /scripts/eval/mme.sh #172

bastian1209 opened this issue Mar 5, 2025 · 1 comment

Comments

@bastian1209
Copy link

Hello, first of all, thank you very much for creating such an excellent codebase that is extremely convenient to use.

My question is about the eval scripts in the scripts/eval/ directory. Among them, only mme.sh has its default conv-mode set to llama. Should it be changed to phi like the other datasets, or is llama the correct setting?

@ZhangXJ199
Copy link
Collaborator

Conv-mode is selected based on the language model and can be changed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants