Skip to content

models openai whisper base cuda gpu

github-actions[bot] edited this page Oct 30, 2025 · 1 revision

openai-whisper-base-cuda-gpu

Overview

This model is an optimized version of Whisper Base for local inference. Optimized models are published here in ONNX format to run on CUDA devices, including server platforms, desktops, and mobile, with the precision best suited to each of these targets.

Review the original model card for details on training data, evaluation metrics, license, intended uses, limitations, and bias before using the model.

Model Description

  • Developed by: Microsoft
  • Model type: ONNX
  • License: apache-2.0
  • Model Description: This is a conversion of the whisper-base model for local inference.
  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Whisper Base for details.

Version: 1

Tags

foundryLocal : test license : apache-2.0 licenseDescription : This model is provided under the License Terms available at https://www.apache.org/licenses/LICENSE-2.0.html. author : Microsoft inputModalities : audio outputModalities : text task : automatic-speech-recognition maxOutputTokens : 2048 alias : whisper-base directoryPath : cuda-fp16 promptTemplate : {"prompt": "<|startoftranscript|> <|en|> <|transcribe|> <|notimestamps|>"}

View in Studio: https://ml.azure.com/registries/azureml/models/openai-whisper-base-cuda-gpu/version/1

License: apache-2.0

Clone this wiki locally