Skip to content

[PH-23] User can't deploy a model if it takes more than 20s to load model files #728

@huaichehuang

Description

@huaichehuang

Bug description
PrimeHub uses a health check during model deployment. However, the time it takes to import and configure the model exceeds the health check duration, resulting in the model service being incorrectly flagged as unhealthy.

Solution
Separate the code in the init function into a standalone function.
When predicting data, check whether the model has been imported and configured.

  • If it has not been configured yet, the user has to configure the standalone function.
  • If it has already been imported and configured, the user can proceed with the prediction directly.

Key Results

  • Can determine the next step based on the model's configuration status.
  • Health check can accurately assess the status of the model deployment.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions