NVIDIA Corporation
Change the repository type filter
All
Repositories list
540 repositories
- AIStore: scalable storage for AI applications
- BioNeMo Framework: For building and adapting AI models in drug discovery at scale
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
- CUDA Core Compute Libraries
- NVIDIA device plugin for Kubernetes
- CUDA Templates for Linear Algebra Subroutines
- TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
- C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows
- the LLM vulnerability scanner
- TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
- Scalable data pre processing and curation toolkit for LLMs
- Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.