-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Milestone
Description
Ollama 0.5 now support outputs constrained to JSON according to a user defined schema.
We could try to integrate this. Possibly by extending the format of the question so the user can pass an output schema.
I'm not sure how we could generalise this to other describers than Ollama. (At the very least BVQA could validate the JSON output, in terms of well-formedness and content).
And whether all models will play well with this constraint. Presumably if a model hasn't been trained to produce JSON, this new feature won't magically produce that out of a generated paragraph.
Metadata
Metadata
Assignees
Labels
No labels