distributed-training repositories

Trending repositories tagged distributed-training, ranked by trending score. Updated daily.

  1. 1
    GokuMohandas/Made-With-ML

    Learn how to develop, deploy and iterate on production-grade ML applications.

    GitHub · Jupyter Notebook · 50,097 stars · 7,824 forks · +16 stars in 24 hours · Trending score 2.19

  2. 2
    skypilot-org/skypilot

    The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

    GitHub · Python · 10,862 stars · 1,360 forks · +6 stars in 24 hours · Trending score 2.09

  3. 3
    AI-Hypercomputer/tpu-codesign

    Hardware-grounded model architecture design principles, MoE co-design patterns, low-precision numerics, and parallelism guides for training and serving on Google Cloud TPUs.

    GitHub · 90 stars · 7 forks · +25 stars in 24 hours · Trending score 1.58

  4. 4
    mindspore-ai/hyper-parallel

    A SuperPod-Affinity Training Acceleration Framework.

    GitHub · Python · 216 stars · 117 forks · +1 stars in 24 hours · Trending score 1.46

  5. 5
    huggingface/pytorch-image-models

    The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

    GitHub · Python · 37,296 stars · 5,233 forks · +3 stars in 24 hours · Trending score 1.43

  6. 6
    Netflix/metaflow

    Build, Manage and Deploy AI/ML Systems

    GitHub · Python · 10,354 stars · 1,395 forks · +3 stars in 24 hours · Trending score 1.43

  7. 7
    whitecircle/halo

    Halo is an open-source framework built by White Circle for training large language and multimodal models

    GitHub · Python · 868 stars · 50 forks · +2 stars in 24 hours · Trending score 1.32

  8. 8
    pytorch/gloo

    Collective communications library with various primitives for multi-machine training.

    GitHub · C++ · 1,468 stars · 374 forks · +1 stars in 24 hours · Trending score 1.15

  9. 9
    redai-studio/Relax

    An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale

    GitHub · Python · 678 stars · 209 forks · +1 stars in 24 hours · Trending score 0.82

  10. 10
    awslabs/awsome-distributed-ai

    Best practices, reference architectures, and examples for distributed AI training and inference on AWS.

    GitHub · Shell · 499 stars · 216 forks · +1 stars in 24 hours · Trending score 0.77

  11. 11
    PaddlePaddle/Paddle

    PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)

    GitHub · C++ · 24,147 stars · 6,021 forks · −1 stars in 24 hours · Trending score 0.56

  12. 12
    AMD-AGI/Primus-Turbo

    A high-performance acceleration library dedicated to large-scale model training on AMD GPUs

    GitHub · Python · 72 stars · 33 forks · +1 stars in 24 hours · Trending score 0.55

  13. 13
    The-AI-Alliance/tapestry

    Project Tapestry aims to give every nation and participant frontier AI they can call their own — uniting a global consortium to train a shared frontier model family from which partners build and own sovereign models aligned to their national, socio-cultural, and industrial needs.

    GitHub · Python · 306 stars · 49 forks · 0 stars in 24 hours · Trending score 0.40

  14. 14
    AMD-AGI/Primus

    A flexible and high-performance training framework designed for large-scale foundation model training on AMD GPUs

    GitHub · Python · 142 stars · 67 forks · 0 stars in 24 hours · Trending score 0.39

  15. 15
    meta-pytorch/torchx

    TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

    GitHub · Python · 429 stars · 158 forks · 0 stars in 24 hours · Trending score 0.37

  16. 16
    traceopt-ai/traceml

    Find why PyTorch training is slow, compare runs, and catch performance regressions in CI.

    GitHub · Python · 189 stars · 33 forks · 0 stars in 24 hours · Trending score 0.32

  17. 17
    KempnerInstitute/KempnerForge

    PyTorch-native framework for fault-tolerant distributed training of foundation models on AI clusters

    GitHub · Python · 25 stars · 4 forks · 0 stars in 24 hours · Trending score 0.31

  18. 18
    tensorcircuit/tensorcircuit-ng

    Next-gen AI-native tensor-network-based quantum software framework

    GitHub · Python · 95 stars · 27 forks · 0 stars in 24 hours · Trending score 0.19

  19. 19
    aws-samples/aws-do-eks

    Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference examples.

    GitHub · Shell · 70 stars · 37 forks · 0 stars in 24 hours · Trending score 0.18

  20. 20
    aws-solutions-library-samples/global-capacity-orchestrator-on-aws

    AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed.

    GitHub · Python · 55 stars · 12 forks · 0 stars in 24 hours · Trending score 0.18

  21. 21
    AMD-AGI/Primus-SaFE

    Primus-SaFE(Stability and Fault Endurance)

    GitHub · Go · 59 stars · 7 forks · 0 stars in 24 hours · Trending score 0.18

  22. 22
    pinpoint-apm/pinpoint-node-agent

    Pinpoint Node.js agent

    GitHub · JavaScript · 63 stars · 10 forks · 0 stars in 24 hours · Trending score 0.09

  23. 23
    compute-factory/compute-factory.github.io

    算力工地 · 面向新手的中文 AI Infra 教学站

    GitHub · JavaScript · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  24. 24
    Lumi-supercomputer/LUMI-AI-Guide

    The LUMI AI Guide is designed to assist users in migrating their machine learning applications from smaller-scale computing environments to the LUMI supercomputer.

    GitHub · Python · 84 stars · 20 forks · 0 stars in 24 hours · Trending score 0.08