Discussions

• 1 You must be logged in to vote

  🙏

  Can I finetune Qwen3-Embedding-4B using axolotl?

  LiorAshkenazy1 asked Jul 3, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Masked thinking tag <think> when preparing SFT dataset

  lcamber asked Jun 30, 2025 in Q&A · Unanswered

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  How to finetune Qwen3 in non-thinking mode?

  chingf asked Jun 26, 2025 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  Consider Installing Miniconda in /workspace Instead of /root in Dockerfile

  alex-ht started Jun 18, 2025 in Ideas

  

  

  2
• 1 You must be logged in to vote

  🙏

  How to train a layer before the first layer of existing models (e.g. gemma) using axolotl?

  GeorgeCarpenter asked May 28, 2025 in Q&A · Answered

  

  

  7
• 1 You must be logged in to vote

  🙏

  Qwen 2.5 32B training (Lora) and hardware constraints

  TheDarkTrumpet asked May 22, 2025 in Q&A · Closed · Unanswered

  

  

  6
• 1 You must be logged in to vote

  🙏

  How does tensorboard reporting work?

  graves asked May 25, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Train with image/label data format

  lleye asked May 22, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Image format for Axolotl multimodal training

  HamidGadirov asked May 3, 2025 in Q&A · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  How can I train QWEN3's reasoning and unreasoning integrated data?

  Foreist asked May 15, 2025 in Q&A · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Axolotl not using more than 46 GB of 143 GB on 8xH200

  jwm1969 asked May 17, 2025 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Checkpoint saves successfully then immediately OOMs at end of training primary save

  mashdragon asked Feb 9, 2025 in Q&A · Closed · Unanswered

  

  

  7
• 1 You must be logged in to vote

  💡

  any plan suport distill in axolotl?

  sankexin started May 15, 2025 in Ideas

  

  

  10
• 1 You must be logged in to vote

  🙏

  will add dapo for RL？

  sankexin asked May 14, 2025 in Q&A · Closed · Answered

  

  

  4
• 1 You must be logged in to vote

  💬

  Installation problem

  Ruiwen505 started May 8, 2025 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  🙏

  How should pre-tokenized data be configured?

  Foreist asked May 7, 2025 in Q&A · Answered

  

  

  10
• 1 You must be logged in to vote

  🙏

  How to run inference on input images?

  HamidGadirov asked May 5, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  OOM with Gemma3-27B-IT on DPO (8×A100, Deepspeed)

  Kshitiz-Khandel asked Apr 24, 2025 in Q&A · Unanswered

  

  

  8
• 1 You must be logged in to vote

  🙏

  Dataset format for multi-turn conversations in DPO

  Kshitiz-Khandel asked Mar 16, 2025 in Q&A · Unanswered

  

  

  

  

  8
• 1 You must be logged in to vote

  💬

  Gemma3-DPO

  Kshitiz-Khandel started Apr 22, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is there any way to do masking with DPO?

  mashdragon asked Dec 28, 2024 in Q&A · Closed · Unanswered

  

  

  9
• 1 You must be logged in to vote

  💬

  Is it possible to train using multiple GPUs with Unsloth?

  Ofir408 started Mar 21, 2025 in General · Closed

  

  

  10
• 1 You must be logged in to vote

  🙏

  Running on LUMI HPC?

  SilverSulfide asked Apr 1, 2025 in Q&A · Unanswered

  

  

  4
• 1 You must be logged in to vote

  🙏

  Qwen 32b fine tune using axolotl

  blazgocompany asked Mar 31, 2025 in Q&A · Closed · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🙏

  Question about Loss Calculation in Multi-Turn Conversations

  Ofir408 asked Mar 23, 2025 in Q&A · Unanswered

  

  

  

  

  3