components Benchmarking documentation

Benchmarking

Components in this category

---

• batch_benchmark_score

• batch_endpoint_preparer

  Prepare the jsonl file and endpoint for batch inference component.

• batch_output_formatter

  Output Formatter for batch inference output

• benchmark_result_aggregator

  Aggregate quality metrics, performance metrics and all of the metadata from the pipeline. Also add them to the root run.

• compute_performance_metrics

  Performs performance metric post processing using data from a model inference run.

• dataset_downloader

  Downloads the dataset onto blob store.

• dataset_sampler

  Samples a dataset containing JSONL file(s).

• endpoint_batch_inference

  Components for batch endpoint inference