Feature: Local Ollama.insteaf of OpenAI

[eugeis]

Type of feature

🍕 Feature

Current behavior

In the current solution OpenAI APII is used.

Suggested solution

I would like to use the solution a local LLM model, concrete the ollama REST API,
https://github.com/jmorganca/ollama/blob/main/docs/api.md.

Would it be possible and what parts of the solution are to change?

Additional context

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

Contributing Docs

• I agree to follow this project's Contribution Docs