@@ -13,52 +13,20 @@ LLM Finetuning toolkit is a config-based CLI tool for launching a series of LLM
13
13
</p >
14
14
15
15
## Installation
16
-
17
- ### Clone Repository
18
-
16
+ ### pipx (recommended)
17
+ pipx installs the package and depdencies in a seperate virtual environment
19
18
``` shell
20
- git clone https://github.com/georgian-io/LLM-Finetuning-Hub.git
21
- cd LLM-Finetuning-Hub/
22
- ```
23
-
24
- ### [ Option 1] Docker (recommended)
25
-
26
- ``` shell
27
- docker build -t llm-toolkit
19
+ pipx install llm-toolkit
28
20
```
29
21
30
- #### CPU Only
31
-
22
+ ### pip
32
23
``` shell
33
- docker run -it llm-toolkit
24
+ pip install llm-toolkit
34
25
```
35
26
36
- #### With GPU
37
-
27
+ ### docker
38
28
``` shell
39
- docker run -it --gpus all llm-toolkit
40
- ```
41
-
42
- ### [ Option 2] Poetry (recommended)
43
-
44
- See poetry documentation page for poetry [ installation instructions] ( https://python-poetry.org/docs/#installation )
45
-
46
- ``` shell
47
- poetry install
48
- ```
49
-
50
- ### [ Option 3] pip
51
-
52
- ``` shell
53
- pip install -r requirements.txt
54
- ```
55
-
56
- ### [ Option 4] Conda
57
-
58
- ``` shell
59
- conda create --name llm-toolkit python=3.11
60
- conda activate llm-toolkit
61
- pip install -r requirements.txt
29
+ docker pull ghcr.io/georgian-io/llm-toolkit:latest
62
30
```
63
31
64
32
## Quick Start
@@ -72,7 +40,7 @@ This guide contains 3 stages that will enable you to get the most out of this to
72
40
### Basic
73
41
74
42
``` python
75
- python toolkit.py -- config ./ config.yml
43
+ llmtune -- config- path ./ config.yml
76
44
```
77
45
78
46
This command initiates the fine-tuning process using the settings specified in the default YAML configuration file ` config.yaml ` .
@@ -256,6 +224,56 @@ If you would like to contribute to this project, we recommend following the "for
256
224
257
225
NOTE : Be sure to merge the latest from "upstream" before making a pull request!
258
226
227
+ # ## Set Up Dev Environment
228
+
229
+ <details>
230
+ <summary>1. Clone Repo</summary>
231
+
232
+ ` ` ` shell
233
+ git clone https://github.com/georgian-io/LLM-Finetuning-Toolkit.git
234
+ cd LLM-Finetuning-Toolkit/
235
+ ` ` `
236
+
237
+ </details>
238
+
239
+ <details>
240
+ <summary>2. Install Dependencies</summary>
241
+ <details>
242
+ <summary>Install with Docker [Recommended]</summary>
243
+
244
+ ` ` ` shell
245
+ docker build -t llm-toolkit
246
+ ` ` `
247
+
248
+ ` ` ` shell
249
+ # CPU
250
+ docker run -it llm-toolkit
251
+ # GPU
252
+ docker run -it --gpus all llm-toolkit
253
+ ` ` `
254
+ </details>
255
+
256
+ <details>
257
+ <summary>Poetry (recommended)</summary>
258
+
259
+ See poetry documentation page for poetry [installation instructions](https://python-poetry.org/docs/#installation)
260
+
261
+ ` ` ` shell
262
+ poetry install
263
+ ` ` `
264
+ </details>
265
+ <details>
266
+ <summary>pip</summary>
267
+ We recommend using a virtual environment like `venv` or `conda` for installation
268
+
269
+ ` ` ` shell
270
+ pip install -e .
271
+ ` ` `
272
+ </details>
273
+ </details>
274
+
275
+
276
+
259
277
# ## Checklist Before Pull Request (Optional)
260
278
261
279
1. Use `ruff check --fix` to check and fix lint errors
0 commit comments