vsi bench evaluation results

[catherinexyz123]

Hi I think it is an excellent work! I am curious about the evaluation results you have reported on VSI Bench. You state that InternVL3-8B has achieved 42.1% accuracy on VSI-Bench. Since different parameters and strategies could cause fluctuation on evaluation results, I am wondering what configuration you have used to evaluate your model on VSI Bench (e.g., frames selected for processing videos, temperature, etc.). Thanks!

[ccx1997]

Looking forward to the releasing of the evaluation script for VSIBench

[csdY123]

The result I measured at 16 frames is 8 points lower than the official one
{
"object_counting": 0.5904,
}

Hi I think it is an excellent work! I am curious about the evaluation results you have reported on VSI Bench. You state that InternVL3-8B has achieved 42.1% accuracy on VSI-Bench. Since different parameters and strategies could cause fluctuation on evaluation results, I am wondering what configuration you have used to evaluate your model on VSI Bench (e.g., frames selected for processing videos, temperature, etc.). Thanks!