model-parallelism repositories

Trending repositories tagged model-parallelism, ranked by trending score. Updated daily.

  1. 1
    deepspeedai/DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    GitHub · Python · 43,348 stars · 5,086 forks · +10 stars in 24 hours · Trending score 2.18

  2. 2
    whitecircle/halo

    Halo is an open-source framework built by White Circle for training large language and multimodal models

    GitHub · Python · 868 stars · 50 forks · +3 stars in 24 hours · Trending score 1.55

  3. 3
    Lowaltitudeflight/local-llm-tuning-guide

    A decision library for running local LLMs on multi-GPU machines without NVLink: parallelism, communication, quantization, speculative decoding, KV cache. Every conclusion carries its evidence grade and reproducible conditions.

    GitHub · Python · 105 stars · 0 forks · 0 stars in 24 hours · Trending score 0.63

  4. 4
    hpcaitech/ColossalAI

    Making large AI models cheaper, faster and more accessible

    GitHub · Python · 41,420 stars · 4,484 forks · 0 stars in 24 hours · Trending score 0.09