recombine vision and language model

[sailfish009]

When I apply autogptq quantization technique to llava onevision 72b model, only language model (Qwen2Config) is applied and vision model remains deleted. Is there any way to combine the vision model again in this state? I know that the llava 72b model itself can apply 4bit quantization and be inferred.