components Foundational Models documentation

Foundational Models

Components in this category

---

• chat_completion_datapreprocess

  Component to preprocess data for chat completion task. See docs to learn more.

• chat_completion_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• chat_completion_pipeline

  Pipeline Component to finetune Hugging Face pretrained models for chat completion task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• diffusers_text_to_image_dreambooth_pipeline

  Pipeline component for text to image dreambooth training using diffusers library and transformers models.

• diffusers_text_to_image_finetune

  Component to finetune stable diffusion models using diffusers for text to image.

• diffusers_text_to_image_model_import

  Import PyTorch / MLflow model

• finetune_common_validation

  Component to validate the finetune job against Validation Service

• ft_nlp_common_validation

  Component to validate the finetune job against Validation Service

• ft_nlp_model_converter

  Component to convert the finetune job output to pytorch and mlflow model

• image_framework_selector

  Framework selector control flow component for image tasks

• image_model_output_selector

  Model output selector control flow component for image tasks

• mmdetection_image_objectdetection_instancesegmentation_finetune

  Component to finetune MMDetection models for image object detection and instance segmentation.

• mmdetection_image_objectdetection_instancesegmentation_model_import

  Import PyTorch / MLflow model

• mmdetection_image_objectdetection_instancesegmentation_pipeline

  Pipeline component for image object detection and instance segmentation using MMDetection models.

• mmtracking_video_multi_object_tracking_finetune

  Component to finetune MMTracking models for video multi-object tracking task.

• mmtracking_video_multi_object_tracking_model_import

  Import PyTorch / MLflow model

• mmtracking_video_multi_object_tracking_pipeline

  Pipeline component for multi-object tracking using MMTracking models.

• multimodal_classification_datapreprocessing

  Component to preprocess data for multimodal classification task

• multimodal_classification_finetune

  Component to finetune multimodal models for classification using MMEFT

• multimodal_classification_model_import

  Import PyTorch / MLflow model

• multimodal_classification_pipeline

  Pipeline component for multimodal classification models.

• oss_chat_completion_finetune

  FTaaS component to finetune model for Chat Completion task

• oss_chat_completion_pipeline

  FTaaS Pipeline component for chat completion

• oss_distillation_batchscoring_datagen_pipeline

  Component to generate data from teacher model endpoint by invoking it in batch.

• oss_distillation_data_generation_batch_scoring_selector

  Component to select the Batch Scoring Selector based on the task type

• oss_distillation_data_generation_file_selector

  Component to select the Batch Scoring Selector based on the task type

• oss_distillation_data_generation_validation_file_checker

  Component to Check if the validation file is present or not

• oss_distillation_generate_data

  Component to generate data from teacher model enpoint

• oss_distillation_generate_data_batch_postprocess

  Component to prepare data returned from teacher model enpoint in batch

• oss_distillation_generate_data_batch_preprocess

  Component to prepare data to invoke teacher model enpoint in batch

• oss_distillation_pipeline

  Component to generate data from teacher model enpoint and finetune student model on generated dataset

• oss_distillation_seq_scoring_pipeline

  Component to generate data from teacher model enpoint(sequentially) and finetune student model on generated dataset

• oss_distillation_validate_pipeline

  Component to validate inputs to the distillation pipeline

• oss_text_generation_finetune

  FTaaS component to finetune model for Text Generation task

• oss_text_generation_pipeline

  FTaaS Pipeline component for text generation

• question_answering_datapreprocess

  Component to preprocess data for question answering task. See docs to learn more.

• question_answering_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• question_answering_pipeline

  Pipeline Component to finetune Hugging Face pretrained models for extractive question answering task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• summarization_datapreprocess

  Component to preprocess data for summarization task. See docs to learn more.

• summarization_finetune

  Component to finetune Hugging Face pretrained models for summarization task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• summarization_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• summarization_pipeline

  Pipeline Component to finetune Hugging Face pretrained models for summarization task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• text_classification_datapreprocess

  Component to preprocess data for single label classification task. See docs to learn more.

• text_classification_finetune

  Component to finetune Hugging Face pretrained models for text classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• text_classification_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• text_classification_pipeline

  Pipeline component to finetune Hugging Face pretrained models for text classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• text_generation_datapreprocess

  Component to preprocess data for text generation task

• text_generation_finetune

  Component to finetune model for Text Generation task

• text_generation_model_import

  Import PyTorch / MLFlow model

• text_generation_pipeline

  Pipeline component for text generation

• text_generation_pipeline_singularity_basic_high

  Pipeline component for text generation

• text_generation_pipeline_singularity_basic_low

  Pipeline component for text generation

• text_generation_pipeline_singularity_basic_medium

  Pipeline component for text generation

• text_generation_pipeline_singularity_premium_high

  Pipeline component for text generation

• text_generation_pipeline_singularity_premium_low

  Pipeline component for text generation

• text_generation_pipeline_singularity_premium_medium

  Pipeline component for text generation

• text_generation_pipeline_singularity_standard_high

  Pipeline component for text generation

• text_generation_pipeline_singularity_standard_low

  Pipeline component for text generation

• text_generation_pipeline_singularity_standard_medium

  Pipeline component for text generation

• token_classification_datapreprocess

  Component to preprocess data for token classification task. See docs to learn more.

• token_classification_finetune

  Component to finetune Hugging Face pretrained models for token classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• token_classification_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• token_classification_pipeline

  Pipeline component to finetune Hugging Face pretrained models for token classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• transformers_image_classification_finetune

  Component to finetune HuggingFace transformers models for image classification.

• transformers_image_classification_model_import

  Import PyTorch / MLflow model

• transformers_image_classification_pipeline

  Pipeline component for image classification using HuggingFace transformers models.

• translation_datapreprocess

  Component to preprocess data for translation task. See docs to learn more.

• translation_finetune

  Component to finetune Hugging Face pretrained models for translation task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• translation_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• translation_pipeline

  Pipeline component to finetune Hugging Face pretrained models for translation task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.