[Bug]: No module named 'transformers_modules.baidu.ERNIE-4 launching with vLLM 0.9.2rc2.dev #

[fernandaspets]

Your current environment

It's not finding the config files in the repo directory?

0.9.2rc2.dev78+g71d1d75b7.d20250708.cu129

I tried:

vllm serve baidu/ERNIE-4.5-VL-28B-A3B-PT --trust-remote-code -tp 2
downloaded locally: vllm serve /mnt/models/baidu/ERNIE-4.5-VL-28B-A3B-PT --trust-remote-code -tp 2

🐛 Describe the bug

errors:

File "/home/strong/.cache/huggingface/modules/transformers_modules/baidu/ERNIE-4.5-VL-28B-A3B-PT/39a152ff17303939b06edc1b8d1a2ea7b31e8ec7/processing_ernie_45t_vl.py", line 46, in (VllmWorker rank=0 pid=95272) ERROR 07-09 03:23:09 [multiproc_executor.py:487] from .tokenization_ernie_45t_vl import Ernie4_5_VLTokenizer (VllmWorker rank=0 pid=95272) ERROR 07-09 03:24:09 [multiproc_executor.py:487] ModuleNotFoundError: No module named 'transformers_modules.baidu.ERNIE-4'

File "/home/strong/.cache/huggingface/modules/transformers_modules/ERNIE-4.5-VL-28B-A3B-PT/processing_ernie_45t_vl.py", line 46, in ERROR 07-09 03:24:16 [core.py:586] from .tokenization_ernie_45t_vl import Ernie4_5_VLTokenizer ERROR 07-09 03:24:16 [core.py:586] ModuleNotFoundError: No module named 'transformers_modules.ERNIE-4.5-VL-28B-A3B-PT' Process

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

Maybe the model repo is out of date, can you try re-downloading it from HF Hub?

[fernandaspets]

Maybe the model repo is out of date, can you try re-downloading it from HF Hub?

Just got this one to work! Thanks! ERNIE-4.5-21B-A3B-PT works! will try the VL one next :)