Open
Description
Hi,
Have you considered LMQL (https://lmql.ai) as a provider? It allows for a more structured outputs, as well as tool use, and it supports both remote providers as well as local models via llama.cpp.
I currently interact with it from Ruby with a slightly modified version of their websocket streaming example, which I can supply if it's useful to you.
PS. Love to see more LLM projects in Ruby, and this is an interesting project
Metadata
Metadata
Assignees
Labels
No labels