Repositories list

• tenplex

  Public
  Dynamic resources changes for multi-dimensional parallelism training

  distributed-mldynamic-resources

  Go

  •

  Apache License 2.0

  •2•26•0•0•Updated Nov 11, 2024Nov 11, 2024

• Megatron-LM

  Public
  Ongoing research training transformer models at scale

  Python

  •

  Other

  •3k•0•0•0•Updated Sep 12, 2024Sep 12, 2024

• transformer-checkpoint

  Public
  Checkpoint structure with Deepspeed and Megatron-LM

  1•1•0•0•Updated Sep 9, 2024Sep 9, 2024

• Megatron-DeepSpeed

  Public
  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Python

  •

  Other

  •3k•0•0•0•Updated Aug 20, 2024Aug 20, 2024

• DeepSpeed

  Public
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Python

  •

  Apache License 2.0

  •4.5k•0•0•0•Updated May 31, 2023May 31, 2023

• mindspore-bert

  Public
  MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

  C++

  •

  Apache License 2.0

  •742•0•0•0•Updated Jun 15, 2022Jun 15, 2022

• kungfu-mindspore

  Public
  Python

  •0•0•0•0•Updated Jan 31, 2022Jan 31, 2022

• mindspore

  Public
  Fork of https://github.com/mindspore-ai/mindspore

  C++

  •

  Apache License 2.0

  •1•3•1•5•Updated Oct 26, 2021Oct 26, 2021

• models

  Public
  Models and examples built with TensorFlow

  Python

  •

  Apache License 2.0

  •46k•0•0•1•Updated Oct 12, 2020Oct 12, 2020

• bert

  Public
  TensorFlow code and pre-trained models for BERT

  Python

  •

  Apache License 2.0

  •9.7k•0•0•0•Updated Sep 4, 2020Sep 4, 2020