feat: Local Model Compatibility #82
Description
Is your feature request related to a problem? Please describe.
Limiting this to OpenAI is severely hampering its capabilities
Describe the solution you'd like
A field to connect this to different endpoints for running different, possibly multiple, LLMs. I think it is reasonable to assume their output is similar in format to OpenAI's API.