Skip to content

@mlcommons MLCommons

Change the repository type filter

All

    Repositories list

    109 repositories

    • mlperf_inference_test_submissions_v5.0

      Public
      Mermaid
      •5•0•0•0•Updated Jul 12, 2025Jul 12, 2025

    • modelbench

      Public
      Run safety benchmarks against AI models and view detailed reports showing how well they performed.
      Python
      •
      Apache License 2.0
      •23•96•365•3•Updated Jul 12, 2025Jul 12, 2025

    • inference_results_v5.0

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v5.0 benchmark.
      benchmarkingbenchmarkmachine-learning
      HTML
      •8•5•3•1•Updated Jul 12, 2025Jul 12, 2025

    • common-crawl-dmlr

      Public
      Rust
      •
      Apache License 2.0
      •0•0•0•0•Updated Jul 12, 2025Jul 12, 2025

    • mlperf_automotive

      Public
      Python
      •
      Apache License 2.0
      •5•3•2•1•Updated Jul 11, 2025Jul 11, 2025

    • tiny

      Public
      MLPerf™ Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers
      C
      •
      Apache License 2.0
      •100•416•14•7•Updated Jul 11, 2025Jul 11, 2025

    • policies

      Public
      General policies for MLPerf™ including submission rules, coding standards, etc.
      Python
      •
      Apache License 2.0
      •61•29•36•48•Updated Jul 11, 2025Jul 11, 2025

    • modelplane

      Public
      Python
      •
      Apache License 2.0
      •0•0•14•1•Updated Jul 11, 2025Jul 11, 2025

    • algorithmic-efficiency

      Public
      MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.
      Python
      •
      Apache License 2.0
      •72•388•27•5•Updated Jul 11, 2025Jul 11, 2025

    • training

      Public
      Reference implementations of MLPerf™ training benchmarks
      benchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •573•1.7k•8•44•Updated Jul 11, 2025Jul 11, 2025

    • dynabench

      Public
      Python
      •
      MIT License
      •17•22•12•4•Updated Jul 11, 2025Jul 11, 2025

    • croissant

      Public
      Croissant is a high-level format for machine learning datasets that brings together four rich layers.
      machine-learningschema-orgjson-lddatasets
      Jupyter Notebook
      •
      Apache License 2.0
      •72•668•154•28•Updated Jul 11, 2025Jul 11, 2025

    • mlperf-automations

      Public
      This repository contains automation scripts designed to run MLPerf Inference benchmarks. Originally developed for the Collective Mind (CM) automation framework, these scripts have been adapted to leverage the MLC automation framework, maintained by the MLCommons Benchmark Infrastructure Working Group.
      automationmlperfmlperf-inferencemlcflowmlperf-automations
      Python
      •
      Apache License 2.0
      •13•5•77•6•Updated Jul 11, 2025Jul 11, 2025

    • training_policies

      Public
      Issues related to MLPerf™ training policies, including rules and suggested changes
      Python
      •
      Apache License 2.0
      •67•95•110•1•Updated Jul 10, 2025Jul 10, 2025

    • mobile_app_open

      Public
      Mobile App Open
      C++
      •
      Apache License 2.0
      •28•57•38•1•Updated Jul 10, 2025Jul 10, 2025

    • inference

      Public
      Reference implementations of MLPerf™ inference benchmarks
      benchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •561•1.4k•216•17•Updated Jul 10, 2025Jul 10, 2025

    • r2-downloader

      Public
      Cloudflare Access + R2 Object Storage Dataset Download Script
      cloudflarecloudflare-accesscloudflare-r2
      Shell
      •
      Apache License 2.0
      •1•0•1•0•Updated Jul 9, 2025Jul 9, 2025

    • GaNDLF

      Public
      A generalizable application framework for segmentation, regression, and classification using PyTorch
      machine-learningframeworkdeep-learningregressionpytorchmedical-imagingclassificationsegmentationdata-augmentationbiomedical-image-processing
      Python
      •
      Apache License 2.0
      •88•179•9•1•Updated Jul 8, 2025Jul 8, 2025

    • inference_policies

      Public
      Issues related to MLPerf™ Inference policies, including rules and suggested changes
      Apache License 2.0
      •54•63•19•3•Updated Jul 8, 2025Jul 8, 2025

    • storage

      Public
      MLPerf™ Storage Benchmark Suite
      performancestoragebenchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •48•154•21•1•Updated Jul 7, 2025Jul 7, 2025

    • medperf

      Public
      An open benchmarking platform for medical artificial intelligence using Federated Evaluation.
      Python
      •
      Apache License 2.0
      •36•160•52•20•Updated Jul 7, 2025Jul 7, 2025

    • inference_results_v3.1

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.
      C++
      •
      Apache License 2.0
      •13•11•9•2•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v3.0

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v3.0 benchmark.
      C++
      •
      Apache License 2.0
      •15•19•11•3•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v4.0

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.
      C++
      •
      Apache License 2.0
      •17•10•5•5•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v4.1

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v4.1 benchmark.
      benchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •2•0•10•0•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v2.1

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v2.1 benchmark.
      Python
      •
      Apache License 2.0
      •23•18•5•3•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v2.0

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v2.0 benchmark.
      Python
      •
      Apache License 2.0
      •12•9•5•0•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v1.1

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v1.1 benchmark.
      Python
      •
      Apache License 2.0
      •25•12•8•4•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v1.0

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v1.0 benchmark.
      C++
      •
      Apache License 2.0
      •25•31•7•0•Updated Jul 1, 2025Jul 1, 2025

    • inference_results_v0.7

      Public archive
      This repository contains the results and code for the MLPerf™ Inference v0.7 benchmark.
      C++
      •
      Apache License 2.0
      •29•17•6•0•Updated Jul 1, 2025Jul 1, 2025