Skip to content

How to use with LightLLM proxy #711

Open
@fellnerse

Description

@fellnerse

I would like to use sgpt with LightLLM proxy, but I only get this error:

Error: error, status code: 404, message: %!s(<nil>)

Any idea on what I'm doing wrong?
The config is this:

maxtokens: 2048
model: bedrock-claude-v3.7
temperature: "1"
topp: "1"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions