Skip to content

Commit 59f914c

Browse files
committed
CI: Use LLama-3.2 1B model
1 parent cb60164 commit 59f914c

File tree

7 files changed

+10
-10
lines changed

7 files changed

+10
-10
lines changed

.github/actions/prepare-llm/action.yml

+4-4
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
name: Prepare Phi-3.5 Mini
2-
description: Download Phi-3.5 Mini and launch it
1+
name: Prepare Small LLM
2+
description: Download small LLM and launch it
33
runs:
44
using: composite
55
steps:
@@ -9,9 +9,9 @@ runs:
99
curl -OL https://github.com/ggerganov/llama.cpp/releases/download/b3614/llama-b3614-bin-ubuntu-x64.zip
1010
unzip llama-b3614-bin-ubuntu-x64.zip
1111
12-
- name: Launch llama.cpp with Phi-3.5 Mini
12+
- name: Launch llama.cpp
1313
shell: bash
14-
run: ./build/bin/llama-server -c 8192 --hf-repo bartowski/Phi-3.5-mini-instruct-GGUF --hf-file Phi-3.5-mini-instruct-Q4_K_M.gguf &
14+
run: ./build/bin/llama-server -c 4096 --hf-repo lmstudio-community/Llama-3.2-1B-Instruct-GGUF --hf-file Llama-3.2-1B-Instruct-Q4_K_M.gguf &
1515

1616
- name: Wait until it is ready
1717
shell: bash

.github/workflows/test-babashka.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ jobs:
1313

1414
- run: bb --version
1515

16-
- name: Prepare LLM (Phi-3 Mini)
16+
- name: Prepare LLM
1717
uses: ./.github/actions/prepare-llm
1818
timeout-minutes: 3
1919

.github/workflows/test-bun.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ jobs:
1414

1515
- run: bun --version
1616

17-
- name: Prepare LLM (Phi-3 Mini)
17+
- name: Prepare LLM
1818
uses: ./.github/actions/prepare-llm
1919
timeout-minutes: 3
2020

.github/workflows/test-cpython.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ jobs:
1111

1212
- run: python3 --version
1313

14-
- name: Prepare LLM (Phi-3 Mini)
14+
- name: Prepare LLM
1515
uses: ./.github/actions/prepare-llm
1616
timeout-minutes: 3
1717

.github/workflows/test-go.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ jobs:
1414

1515
- run: go version
1616

17-
- name: Prepare LLM (Phi-3 Mini)
17+
- name: Prepare LLM
1818
uses: ./.github/actions/prepare-llm
1919
timeout-minutes: 3
2020

.github/workflows/test-nodejs.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ jobs:
1111

1212
- run: node --version
1313

14-
- name: Prepare LLM (Phi-3 Mini)
14+
- name: Prepare LLM
1515
uses: ./.github/actions/prepare-llm
1616
timeout-minutes: 3
1717

.github/workflows/test-pypy.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ jobs:
1515

1616
- run: pypy3 --version
1717

18-
- name: Prepare LLM (Phi-3 Mini)
18+
- name: Prepare LLM
1919
uses: ./.github/actions/prepare-llm
2020
timeout-minutes: 3
2121

0 commit comments

Comments
 (0)