components Foundational Models documentation

Foundational Models

Components in this category

---

• chat_completion_datapreprocess

  Component to preprocess data for chat completion task. See docs to learn more.

• chat_completion_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• chat_completion_pipeline

  Pipeline Component to finetune Hugging Face pretrained models for chat completion task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• diffusers_text_to_image_model_import

  Import PyTorch / MLflow model

• finetune_common_validation

  Component to validate the finetune job against Validation Service

• ft_nlp_common_validation

  Component to validate the finetune job against Validation Service

• ft_nlp_model_converter

  Component to convert the finetune job output to pytorch and mlflow model

• image_framework_selector

  Framework selector control flow component for image tasks

• image_model_output_selector

  Model output selector control flow component for image tasks

• medical_image_embedding_datapreprocessing

  To generate embeddings for medical images.

• medimage_embedding_adapter_merge

  Integrate labels and generates classification model

• medimage_insight_ft_pipeline

  Pipeline Component to finetune MedImageInsight Model.

• mmdetection_image_objectdetection_instancesegmentation_finetune

  Component to finetune MMDetection models for image object detection and instance segmentation.

• mmdetection_image_objectdetection_instancesegmentation_model_import

  Import PyTorch / MLflow model

• mmdetection_image_objectdetection_instancesegmentation_pipeline

  Pipeline component for image object detection and instance segmentation using MMDetection models.

• mmtracking_video_multi_object_tracking_model_import

  Import PyTorch / MLflow model

• oss_chat_completion_finetune

  FTaaS component to finetune model for Chat Completion task

• oss_chat_completion_pipeline

  FTaaS Pipeline component for chat completion

• oss_distillation_batchscoring_datagen_pipeline

  Component to generate data from teacher model endpoint by invoking it in batch.

• oss_distillation_data_generation_batch_scoring_selector

  Component to select the Batch Scoring Selector based on the task type

• oss_distillation_data_generation_file_selector

  Component to select the Batch Scoring Selector based on the task type

• oss_distillation_data_generation_validation_file_checker

  Component to Check if the validation file is present or not

• oss_distillation_generate_data

  Component to generate data from teacher model enpoint

• oss_distillation_generate_data_batch_postprocess

  Component to prepare data returned from teacher model enpoint in batch

• oss_distillation_generate_data_batch_preprocess

  Component to prepare data to invoke teacher model enpoint in batch

• oss_distillation_seq_scoring_pipeline

  Component to generate data from teacher model enpoint(sequentially) and finetune student model on generated dataset

• oss_distillation_validate_pipeline

  Component to validate inputs to the distillation pipeline

• oss_text_generation_finetune

  FTaaS component to finetune model for Text Generation task

• oss_text_generation_pipeline

  FTaaS Pipeline component for text generation

• question_answering_datapreprocess

  Component to preprocess data for question answering task. See docs to learn more.

• question_answering_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• question_answering_pipeline

  Pipeline Component to finetune Hugging Face pretrained models for extractive question answering task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• summarization_datapreprocess

  Component to preprocess data for summarization task. See docs to learn more.

• summarization_finetune

  Component to finetune Hugging Face pretrained models for summarization task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• summarization_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• summarization_pipeline

  Pipeline Component to finetune Hugging Face pretrained models for summarization task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• text_classification_datapreprocess

  Component to preprocess data for single label classification task. See docs to learn more.

• text_classification_finetune

  Component to finetune Hugging Face pretrained models for text classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• text_classification_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• text_classification_pipeline

  Pipeline component to finetune Hugging Face pretrained models for text classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• text_generation_datapreprocess

  Component to preprocess data for text generation task

• text_generation_finetune

  Component to finetune model for Text Generation task

• text_generation_model_import

  Import PyTorch / MLFlow model

• text_generation_pipeline

  Pipeline component for text generation

• text_generation_pipeline_singularity_basic_high

  Pipeline component for text generation

• text_generation_pipeline_singularity_basic_low

  Pipeline component for text generation

• text_generation_pipeline_singularity_basic_medium

  Pipeline component for text generation

• text_generation_pipeline_singularity_premium_high

  Pipeline component for text generation

• text_generation_pipeline_singularity_premium_low

  Pipeline component for text generation

• text_generation_pipeline_singularity_premium_medium

  Pipeline component for text generation

• text_generation_pipeline_singularity_standard_high

  Pipeline component for text generation

• text_generation_pipeline_singularity_standard_low

  Pipeline component for text generation

• text_generation_pipeline_singularity_standard_medium

  Pipeline component for text generation

• token_classification_datapreprocess

  Component to preprocess data for token classification task. See docs to learn more.

• token_classification_finetune

  Component to finetune Hugging Face pretrained models for token classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• token_classification_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• token_classification_pipeline

  Pipeline component to finetune Hugging Face pretrained models for token classification task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• transformers_image_classification_finetune

  Component to finetune HuggingFace transformers models for image classification.

• transformers_image_classification_model_import

  Import PyTorch / MLflow model

• transformers_image_classification_pipeline

  Pipeline component for image classification using HuggingFace transformers models.

• translation_datapreprocess

  Component to preprocess data for translation task. See docs to learn more.

• translation_finetune

  Component to finetune Hugging Face pretrained models for translation task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.

• translation_model_import

  Component to import PyTorch / MLFlow model. See docs to learn more.

• translation_pipeline

  Pipeline component to finetune Hugging Face pretrained models for translation task. The component supports optimizations such as LoRA, Deepspeed and ONNXRuntime for performance enhancement. See docs to learn more.