Llama 4 - hf-to-gguf model Llama4ForConditionalGeneration is not supported #12789

Unanswered

Notbici asked this question in Q&A

Notbici
Apr 7, 2025

Hi guys,

I'm attempting to convert a HF safetensors model to GGUF and am presented with:

command: > python convert_hf_to_gguf.py /home/llama4/llama4-scout-17b-16e-instruct/models--meta-llama--Llama-4-Scout-17B-16E-Instruct/snapshots/4bd10c4dc905b4000d76640d07a552344146faec/ --outfile llama4scout17b16e-instruct.gguf

output>: > INFO:hf-to-gguf:Loading model: 4bd10c4dc905b4000d76640d07a552344146faec
ERROR:hf-to-gguf:Model Llama4ForConditionalGeneration is not supported

Any ideas on what to do here?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment