Skip to content

Commit

Permalink
type
Browse files Browse the repository at this point in the history
Signed-off-by: Sertac Ozercan <[email protected]>
  • Loading branch information
sozercan committed Jan 11, 2024
1 parent ccb0907 commit 19449ee
Showing 1 changed file with 12 additions and 12 deletions.
24 changes: 12 additions & 12 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -53,21 +53,21 @@ AIKit comes with pre-made models that you can use out-of-the-box!

### CPU

| Model | Parameters | Command |
| --------- | ---------- | --------------------------------------------------------------- |
| πŸ¦™ Llama 2 | 7B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/llama2:7b` |
| πŸ¦™ Llama 2 | 13B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/llama2:13b` |
| 🐬 Orca 2 | 13B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/orca2:13b` |
| Ⓜ️ Mixtral | 8x7B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/mixtral:8x7b` |
| Model | Type | Parameters | Command |
| --------- | -------- | ---------- | --------------------------------------------------------------- |
| πŸ¦™ Llama 2 | Chat | 7B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/llama2:7b` |
| πŸ¦™ Llama 2 | Chat | 13B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/llama2:13b` |
| 🐬 Orca 2 | | 13B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/orca2:13b` |
| Ⓜ️ Mixtral | Instruct | 8x7B | `docker run -d --rm -p 8080:8080 ghcr.io/sozercan/mixtral:8x7b` |

### NVIDIA CUDA

| Model | Parameters | Command |
| --------- | ---------- | ------------------------------------------------------------------------------- |
| πŸ¦™ Llama 2 | 7B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/llama2:7b-cuda` |
| πŸ¦™ Llama 2 | 13B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/llama2:13b-cuda` |
| 🐬 Orca 2 | 13B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/orca2:13b-cuda` |
| Ⓜ️ Mixtral | 8x7B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/mixtral:8x7b-cuda` |
| Model | Type | Parameters | Command |
| -------------- | -------- | ---------- | ------------------------------------------------------------------------------- |
| πŸ¦™ Llama 2 Chat | Chat | 7B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/llama2:7b-cuda` |
| πŸ¦™ Llama 2 Chat | Chat | 13B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/llama2:13b-cuda` |
| 🐬 Orca 2 | | 13B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/orca2:13b-cuda` |
| Ⓜ️ Mixtral | Instruct | 8x7B | `docker run -d --rm --gpus all -p 8080:8080 ghcr.io/sozercan/mixtral:8x7b-cuda` |

> [!NOTE]
> Please see [models folder](./models/) for pre-made model definitions.
Expand Down

0 comments on commit 19449ee

Please sign in to comment.