Guidance on Fine-Tuning Soundwave

[world1tree]

Great work on this project! I'm interested in fine-tuning Soundwave and would love to receive some instructions. Could you share any tips, code snippets, or steps to help me get started? Thank you!

[xiaozhang521]

Currently, we are working hard to update our model and have not yet fully cleaned our training code. Generally, the fine-tuning code we mainly refer to Qwen's finetune.py, while the data format follows LLaMA. To process audio, an easy approach is to use Whisper, as demonstrated in our run_inference.py. Hope this helps! :)

[ovaiscse]

Hey world1tree ,where you able to finetune soundwave using zhangs instructions, please reply

[world1tree]

Hey world1tree ,where you able to finetune soundwave using zhangs instructions, please reply

Sorry I haven't kept up with this work, but I'm definitely excited to see others give it a shot and hopefully succeed!

[wx-333]

can you share training codes and data,thanks!