Skip to content

bjoxiah/finetuning-phi-3-tutorial

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

9 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ€– Fine-Tune Phi-3 on Custom Data

Complete guide to fine-tuning Microsoft's Phi-3 on your own data and deploying to production.

Open In Colab YouTube

πŸš€ Quick Start

Google Colab (Recommended)

Click the badge above to open in Colab and run cell-by-cell.

πŸŽ₯ Video Tutorial

Watch the complete walkthrough: YouTube Link

Timestamps:

  • 00:00 - Intro
  • 00:59 - Fine-Tuning Processes
  • 03:20 - Colab Code Review
  • 15:14 - Conclusion

πŸ“ Repository Structure

  • notebooks/: Interactive Jupyter/Colab notebooks
  • data/: Sample dataset

πŸ“Š Data Format

Your training data should be in JSONL format:

{
  "messages": [
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "What is X?"},
    {"role": "assistant", "content": "X is..."}
  ]
}

See data/sample_training_data.jsonl for examples.

🀝 Contributing

Contributions, feedback, and suggestions are welcome!

About

A step by step practical approach to finetuning microsoft phi-3 llm using unsloth

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published