distributed-training repositories
Trending repositories tagged distributed-training, ranked by trending score. Updated daily.
-
1
GokuMohandas/Made-With-ML
Learn how to develop, deploy and iterate on production-grade ML applications.
GitHub · Jupyter Notebook · 50,097 stars · 7,824 forks · +16 stars in 24 hours · Trending score 2.19
-
2
skypilot-org/skypilot
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
GitHub · Python · 10,862 stars · 1,360 forks · +6 stars in 24 hours · Trending score 2.09
-
3
AI-Hypercomputer/tpu-codesign
Hardware-grounded model architecture design principles, MoE co-design patterns, low-precision numerics, and parallelism guides for training and serving on Google Cloud TPUs.
GitHub · 90 stars · 7 forks · +25 stars in 24 hours · Trending score 1.58
-
4
mindspore-ai/hyper-parallel
A SuperPod-Affinity Training Acceleration Framework.
GitHub · Python · 216 stars · 117 forks · +1 stars in 24 hours · Trending score 1.46
-
5
huggingface/pytorch-image-models
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
GitHub · Python · 37,296 stars · 5,233 forks · +3 stars in 24 hours · Trending score 1.43
-
6
Netflix/metaflow
Build, Manage and Deploy AI/ML Systems
GitHub · Python · 10,354 stars · 1,395 forks · +3 stars in 24 hours · Trending score 1.43
-
7
whitecircle/halo
Halo is an open-source framework built by White Circle for training large language and multimodal models
GitHub · Python · 868 stars · 50 forks · +2 stars in 24 hours · Trending score 1.32
-
8
pytorch/gloo
Collective communications library with various primitives for multi-machine training.
GitHub · C++ · 1,468 stars · 374 forks · +1 stars in 24 hours · Trending score 1.15
-
9
redai-studio/Relax
An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale
GitHub · Python · 678 stars · 209 forks · +1 stars in 24 hours · Trending score 0.82
-
10
awslabs/awsome-distributed-ai
Best practices, reference architectures, and examples for distributed AI training and inference on AWS.
GitHub · Shell · 499 stars · 216 forks · +1 stars in 24 hours · Trending score 0.77
-
11
PaddlePaddle/Paddle
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
GitHub · C++ · 24,147 stars · 6,021 forks · −1 stars in 24 hours · Trending score 0.56
-
12
AMD-AGI/Primus-Turbo
A high-performance acceleration library dedicated to large-scale model training on AMD GPUs
GitHub · Python · 72 stars · 33 forks · +1 stars in 24 hours · Trending score 0.55
-
13
The-AI-Alliance/tapestry
Project Tapestry aims to give every nation and participant frontier AI they can call their own — uniting a global consortium to train a shared frontier model family from which partners build and own sovereign models aligned to their national, socio-cultural, and industrial needs.
GitHub · Python · 306 stars · 49 forks · 0 stars in 24 hours · Trending score 0.40
-
14
AMD-AGI/Primus
A flexible and high-performance training framework designed for large-scale foundation model training on AMD GPUs
GitHub · Python · 142 stars · 67 forks · 0 stars in 24 hours · Trending score 0.39
-
15
meta-pytorch/torchx
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
GitHub · Python · 429 stars · 158 forks · 0 stars in 24 hours · Trending score 0.37
-
16
traceopt-ai/traceml
Find why PyTorch training is slow, compare runs, and catch performance regressions in CI.
GitHub · Python · 189 stars · 33 forks · 0 stars in 24 hours · Trending score 0.32
-
17
KempnerInstitute/KempnerForge
PyTorch-native framework for fault-tolerant distributed training of foundation models on AI clusters
GitHub · Python · 25 stars · 4 forks · 0 stars in 24 hours · Trending score 0.31
-
18
tensorcircuit/tensorcircuit-ng
Next-gen AI-native tensor-network-based quantum software framework
GitHub · Python · 95 stars · 27 forks · 0 stars in 24 hours · Trending score 0.19
-
19
aws-samples/aws-do-eks
Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference examples.
GitHub · Shell · 70 stars · 37 forks · 0 stars in 24 hours · Trending score 0.18
-
20
aws-solutions-library-samples/global-capacity-orchestrator-on-aws
AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed.
GitHub · Python · 55 stars · 12 forks · 0 stars in 24 hours · Trending score 0.18
-
21
AMD-AGI/Primus-SaFE
Primus-SaFE(Stability and Fault Endurance)
GitHub · Go · 59 stars · 7 forks · 0 stars in 24 hours · Trending score 0.18
-
22
pinpoint-apm/pinpoint-node-agent
Pinpoint Node.js agent
GitHub · JavaScript · 63 stars · 10 forks · 0 stars in 24 hours · Trending score 0.09
-
23
compute-factory/compute-factory.github.io
算力工地 · 面向新手的中文 AI Infra 教学站
GitHub · JavaScript · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
24
Lumi-supercomputer/LUMI-AI-Guide
The LUMI AI Guide is designed to assist users in migrating their machine learning applications from smaller-scale computing environments to the LUMI supercomputer.
GitHub · Python · 84 stars · 20 forks · 0 stars in 24 hours · Trending score 0.08