Skip to content

components finetune_common_validation

github-actions[bot] edited this page Nov 27, 2023 · 7 revisions

Common Validation Component

finetune_common_validation

Overview

Component to validate the finetune job against Validation Service

Version: 0.0.1

View in Studio: https://ml.azure.com/registries/azureml/components/finetune_common_validation/version/0.0.1

Inputs

component input: mlflow model path

Name Description Type Default Optional Enum
mlflow_model_path MLflow model asset path. Special characters like \ and ' are invalid in the parameter value. mlflow_model True

Data validation component input: training mltable

Name Description Type Default Optional Enum
training_data Path to the mltable of the training dataset. mltable False

optional component input: validation mltable

Name Description Type Default Optional Enum
validation_data Path to the mltable of the validation dataset. mltable True

component input: test mltable

Name Description Type Default Optional Enum
test_data Path to the mltable of the test dataset. mltable True

Compute validation

Name Description Type Default Optional Enum
compute_preprocess Compute to be used for preprocess eg. provide 'FT-Cluster' if your compute is named 'FT-Cluster'. Special characters like \ and ' are invalid in the parameter value. If compute cluster name is provided, instance_type field will be ignored and the respective cluster will be used. string True
instance_type_preprocess Instance type to be used for preprocess component in case of serverless compute, eg. standard_d12_v2. The parameter compute_preprocess must be set to 'serverless' for instance_type to be used string True
compute_model_import Compute to be used for model_import eg. provide 'FT-Cluster' if your compute is named 'FT-Cluster' string True
instance_type_model_import Instance type to be used for model_import component in case of serverless compute, eg. standard_d12_v2. The parameter compute_model_import must be set to 'serverless' for instance_type to be used string True
compute_finetune Compute to be used for finetuning eg. provide 'FT-Cluster' if your compute is named 'FT-Cluster'. Special characters like \ and ' are invalid in the parameter value. If compute cluster name is provided, instance_type field will be ignored and the respective cluster will be used string True
instance_type_finetune Instance type to be used for finetune component in case of serverless compute, eg. standard_nc24rs_v3. The parameter compute_finetune must be set to 'serverless' for instance_type to be used string True
instance_count Number of nodes to be used for finetuning (used for distributed training) integer 1 True
process_count_per_instance Number of gpus to be used per node for finetuning, should be equal to number of gpu per node in the compute SKU used for finetune integer 1 True
compute_model_evaluation Compute to be used for model evaluation eg. provide 'FT-Cluster' if your compute is named 'FT-Cluster' string True
instance_type_model_evaluation Instance type to be used for model_evaluation components in case of serverless compute, eg. standard_nc24rs_v3. The parameter compute_model_evaluation must be set to 'serverless' for instance_type to be used string True
task_name Which task the model is solving. string ['tabular-classification', 'tabular-classification-multilabel', 'tabular-regression', 'text-classification', 'text-classification-multilabel', 'text-named-entity-recognition', 'text-summarization', 'question-answering', 'text-translation', 'text-generation', 'fill-mask', 'image-classification', 'image-classification-multilabel', 'image-object-detection', 'image-instance-segmentation', 'video-multi-object-tracking']

ME validation

Name Description Type Default Optional Enum
test_batch_size Test batch size. integer 1 True
label_column_name Label column name in provided test dataset, for example "label". string label True
input_column_names Input column names in provided test dataset, for example column1. Add comma delimited values in case of multiple input columns, for example column1,column2. string image_url True
device string auto False ['auto', 'cpu', 'gpu']
evaluation_config Additional parameters for Computing Metrics. uri_file True
evaluation_config_params Additional parameters as JSON serialized string. string True

Task Speciffic params validation

Name Description Type Default Optional Enum
task_specific_extra_params All extra params string True

Outputs

Name Description Type
validation_info Validation status. uri_file

Environment

azureml://registries/azureml/environments/acpt-pytorch-2.0-cuda11.7/versions/21

Clone this wiki locally