grok api

[kaly9]

can you use grok api instead of open ai ?

[dot-Justin]

Do you mean Groq? Groq is pretty compatible with the openai API, but one major thing is that it doesn't support any vision queries. https://console.groq.com/docs/openai

[kaly9]

yes that what i mean, Groq is very fast and free if we found a free vision api or local vision that well be great

[dot-Justin]

Potentially Groq running llama3 with Ollama running Llava locally