Skip to content

Commit c791544

Browse files
committed
Add note about moondream.
1 parent 3d22ef1 commit c791544

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

README.md

+3-1
Original file line numberDiff line numberDiff line change
@@ -67,9 +67,11 @@ docker logs -f CONTAINER_ID_HERE
6767
```
6868
curl -X POST 'http://localhost:8000/api/chat' \
6969
--header 'Content-Type: application/json' \
70-
--data '{ "messages": [ { "role": "system", "content": "You are a mathematician" }, { "role": "user", "content": "What is 1+1?"} ], "model": "llama3.1", "stream": false }'
70+
--data '{ "messages": [ { "role": "system", "content": "You are a mathematician" }, { "role": "user", "content": "Why is the sky blue"} ], "model": "moondream", "stream": false }'
7171
```
7272

73+
We use `moondream` model because it's the smallest model, and we were receiving OOM errors on this maintainer's local machine otherwise.
74+
7375
### Other Commands:
7476

7577
What follows is a list of commands that, while not strictly necessary, were helpful when developing this load balancer.

0 commit comments

Comments
 (0)