Ollama integration

[Christian-Prather]

Hello,
Love the tooling. I was wondering if there is any advice or docs you could point me to for getting this integrated with a local ollama server?

I am very interested in this for some local PR reviews (local gitlab) and would like to keep the model local as well.

Thank you

[malinosqui]

Hey @Christian-Prather

Here’s the quick-and-dirty way to plug Kodus into a local Ollama instance:

---

1. Run Ollama in “OpenAI mode”

ollama serve          # listens on http://localhost:11434
ollama pull llama3    # or whichever model you want

2. Follow our Together.ai doc but swap three fields

Full guide: https://docs.kodus.io/cookbook/en/together
Only change what’s in the table:

Field	Together.ai value	Your Ollama value
Base URL	https://api.together.xyz/v1	http://<YOUR-HOST>:11434/v1
API key	TOGETHER_API_KEY=…	(blank) or your OLLAMA_API_KEY
Model	togethercomputer/llama-3-8b	name from ollama list, e.g. llama3:latest

Just ping me on our Discord if you need a hand! 😊 Happy to help.