Skip to content

Support for JSON outputs #17

@geoffroy-noel-ddh

Description

@geoffroy-noel-ddh

Ollama 0.5 now support outputs constrained to JSON according to a user defined schema.

We could try to integrate this. Possibly by extending the format of the question so the user can pass an output schema.

I'm not sure how we could generalise this to other describers than Ollama. (At the very least BVQA could validate the JSON output, in terms of well-formedness and content).

And whether all models will play well with this constraint. Presumably if a model hasn't been trained to produce JSON, this new feature won't magically produce that out of a generated paragraph.

Metadata

Metadata

Labels

No labels
No labels

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions