Skip to content

[FEATURE] Avoid a single function stuck forever #658

@badmonster0

Description

@badmonster0

Sometimes a single function can be stuck for a really long time, e.g. Ollama (bug). Our users experienced it and described in #656.

  • If a function takes really long time (e.g. more than 30s), log a warning with specific function name.
  • Each function may have a timeout (we can start from 300s as default, don't want it to be too short as some functions indeed needs long time sometimes, e.g. some PDF parsing; and each function can override it, similar to the setting to enable cache). We abort the function and return an error if timeout.

Side note: in the future we also want to expose more metrics/stats and allow users to inspect pending functions in cocoinsight


❤️ Contributors, please refer to 📙Contributing Guide.
Unless the PR can be sent immediately (e.g. just a few lines of code), we recommend you to leave a comment on the issue like I'm working on it or Can I work on this issue? to avoid duplicating work. Our Discord server is always open and friendly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions