-
Notifications
You must be signed in to change notification settings - Fork 127
components validation_trigger_model_evaluation
github-actions[bot] edited this page Dec 19, 2024
·
23 revisions
Component for enabling validation of model evaluation pipeline.
Version: 0.0.36
type : evaluation
sub_type : validation
Internal
View in Studio: https://ml.azure.com/registries/azureml/components/validation_trigger_model_evaluation/version/0.0.36
Name | Description | Type | Default | Optional | Enum |
---|---|---|---|---|---|
compute_name | string | serverless | |||
compute_instance_type | string | STANDARD_NC24S_V3 |
model prediction
Name | Description | Type | Default | Optional | Enum |
---|---|---|---|---|---|
task | Task type | string | tabular-classification | ['tabular-classification', 'tabular-classification-multilabel', 'tabular-regression', 'text-classification', 'text-classification-multilabel', 'text-named-entity-recognition', 'text-summarization', 'question-answering', 'text-translation', 'text-generation', 'fill-mask', 'image-classification', 'image-classification-multilabel', 'image-object-detection', 'image-instance-segmentation'] | |
test_data | Test Data | uri_folder | False | ||
mlflow_model_path | Mlflow Model (could be a registered model or part of another pipeline | mlflow_model | False | ||
label_column_name | Label column name in provided test dataset (Ex: label) | string | True | ||
input_column_names | Input column names in provided test dataset (Ex : column1). Add comma delimited values in case of multiple input columns (Ex : column1,column2) | string | True | ||
device | string | auto | False | ['auto', 'cpu', 'gpu'] | |
batch_size | integer | True |
compute metrics
Name | Description | Type | Default | Optional | Enum |
---|---|---|---|---|---|
evaluation_config | Additional parameters required for evaluation. See How to create a config here | uri_file | True | ||
evaluation_config_params | JSON Serialized string of evaluation_config | string | True |
Name | Description | Type |
---|---|---|
output | boolean |
azureml://registries/azureml/environments/model-evaluation/labels/latest