Search results

Slow execution

Status: Open.

#767 In EvolvingLMMs-Lab/lmms-eval;

· lsm2842035890 opened on Jul 21, 2025

Dataset lmms-lab/OlympiadBench does exist on Hugging Face

Status: Open.

#765 In EvolvingLMMs-Lab/lmms-eval;

· yaojingguo opened on Jul 20, 2025

VideoMMMU Results with Qwen2.5-VL

Status: Open.

#763 In EvolvingLMMs-Lab/lmms-eval;

· sming256 opened on Jul 17, 2025

Issues when using llava_vid.py to evaluate the llava-onevision-qwen2-7b-ov model

Status: Open.

#761 In EvolvingLMMs-Lab/lmms-eval;

· SplendidYuan opened on Jul 16, 2025

两种评测方式结果差别很大是怎么回事。

Status: Open.

#751 In EvolvingLMMs-Lab/lmms-eval;

· mathCrazyy opened on Jul 10, 2025

The results of evaluation on multi-GPUs versus single-GPU differ from each other

Status: Open.

#750 In EvolvingLMMs-Lab/lmms-eval;

· shuangchen2003 opened on Jul 10, 2025

when to support lmms-lab/MMMU interleaved_format evaluation?

Status: Open.

#748 In EvolvingLMMs-Lab/lmms-eval;

· zhiwenhou1227 opened on Jul 10, 2025

Abnormal GPU Utilization When Evaluating Qwen 2.5 VL 72B

Status: Open.

#738 In EvolvingLMMs-Lab/lmms-eval;

· LiamLian0727 opened on Jul 6, 2025

Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1

bugSomething isn't workingSomething isn't working

Status: Open.

#735 In EvolvingLMMs-Lab/lmms-eval;

· anurag-198 opened on Jul 2, 2025

how to download the dataset correctly?

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#732 In EvolvingLMMs-Lab/lmms-eval;

· Sugar929 opened on Jul 1, 2025

Support for MiMo-VL-7B

bugSomething isn't workingSomething isn't working

Status: Open.

Feature

#729 In EvolvingLMMs-Lab/lmms-eval;

· ChangtiWu opened on Jun 25, 2025

Is it possible to add support for llava-hf/llava-onevision-qwen2-7b-ov-hf?

bugSomething isn't workingSomething isn't working

discussion

Status: Open.

Bug

#722 In EvolvingLMMs-Lab/lmms-eval;

· tianyuzong opened on Jun 19, 2025