[Fine-tuning Code] Here is an implementation 👋 !

[Gaiejj]

😊 Hi everyone! We are very pleased to announce that align-anything now supports fine-tuning for Qwen2.5-Omni. The code is here 👉 PKU-Alignment/align-anything#169.

Compared to the community's implementation, we believe our solution is more user-friendly. You just need to run the following script after installation to start training without modifying anything!

• Installation:

# We tested on the H800 computing cluster, and this version of CUDA works well.
# You can adjust this version according to the computing cluster's actual situation.

conda install nvidia/label/cuda-12.2.0::cuda
export CUDA_HOME=$CONDA_PREFIX
cd align-anything
pip install -e .[train]

# for qwen2.5-omni
pip uninstall transformers
pip install git+https://github.com/huggingface/transformers@3a1ead0aabed473eafe527915eea8c197d424356
pip install -U flash-attn --no-build-isolation

• train

cd scripts
bash qwen_omni_sft.sh

[hm-li0420]

Wonderful work, Looking forward to the code for fine-tuning the audio part being implemented soon.

[caopulan]

Great work! I'm wondering when audio2audio fine-tuning will be implemented?

[GasimV]

cd scripts
bash qwen_omni_sft.sh

This script doesn't exist now in the path. Is it anywhere else or was deleted totally? Can you, please, provide the current actual path, if it was relocated? Thanks.

[Ankit-Zefan]

cd scripts bash qwen_omni_sft.sh

This script doesn't exist now in the path. Is it anywhere else or was deleted totally? Can you, please, provide the current actual path, if it was relocated? Thanks.

hi did you get the qwen omni script ?

[GasimV]

cd scripts bash qwen_omni_sft.sh

This script doesn't exist now in the path. Is it anywhere else or was deleted totally? Can you, please, provide the current actual path, if it was relocated? Thanks.

hi did you get the qwen omni script ?

No, my question remains unanswered yet.

[BBieringIH]

Is there any update on this? Would be great to have a script to fine-tune Qwen2.5-omni models.