Skip to content

confidence metric broken #13

@azliu0

Description

@azliu0

in commit 3836f92, we switched from doing embedding inference on the server to using openai embeddings, since we don't have enough space on render.

the confidence metric seems to be much smaller / lower variance on average. tweak the current formulas so that the confidence metric displayed in the inbox makes sense and is reasonably normalized

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinggood first issueGood for newcomershelp wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions