Skip to content

Commit 99af403

Browse files
authored
Generate preference dataset with Llama 3.1 70B (#289)
1 parent 7f1e071 commit 99af403

File tree

4 files changed

+8306
-3
lines changed

4 files changed

+8306
-3
lines changed
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,12 @@
11
# Chapter 7: Finetuning to Follow Instructions
22

3-
In progress ...
3+
- [create-preference-data-ollama.ipynb](create-preference-data-ollama.ipynb): A notebook that creates a synthetic dataset for preference finetuning dataset using Llama 3.1 and Ollama
44

5-
In the meantime, see
5+
- In progress ...
6+
7+
8+
9+
In the meantime, also see
610

711
- LLM Training: RLHF and Its Alternatives, [https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives](https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives)
812
- Tips for LLM Pretraining and Evaluating Reward Models, [https://sebastianraschka.com/blog/2024/research-papers-in-march-2024.html](https://sebastianraschka.com/blog/2024/research-papers-in-march-2024.html)

0 commit comments

Comments
 (0)