DiffusionVL Preatraining

[AmeenAli]

Thanks for sharing this awesome work!!

One question, in the training scripts, I saw that you have provided pretraining + finetuning scripts for both llava + llada.

But for DiffusionVL i only see finetuning for Qwen and QwenVL, is there any chance you could also provide the pretraining scripts for DiffusionVL

[xiazhi1]

Thanks for sharing this awesome work!!

One question, in the training scripts, I saw that you have provided pretraining + finetuning scripts for both llava + llada.

But for DiffusionVL i only see finetuning for Qwen and QwenVL, is there any chance you could also provide the pretraining scripts for DiffusionVL

@AmeenAli Hi there, sincerely apologize for the late reply.

To answer your question: DiffusionVL is built directly by fine-tuning Qwen and QwenVL.

We do not have a separate pre-training stage for it. The "finetuning" scripts provided in the repo are exactly what you need to train DiffusionVL from the base Qwen models.