Skip to content

Idea: Model servers #161

@jmintb

Description

@jmintb

Just like we have executors for Tasks, we need something similar for deploying models. Right now AME is coupled to mlflow for serving models but that needs to change. This requires new options in the AME files.

The proposed change:

# main project ame.yml
project: xgboost_project
models:
  - name: product_recommendor
    training:
      task: 
        taskRef: train_my_model 
    deployment:
      server:
        !customer
        command: python serve.py
        pythonVersion: 3.11
        deps: pip

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions