model-parallelism repositories
Trending repositories tagged model-parallelism, ranked by trending score. Updated daily.
-
1
deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
GitHub · Python · 43,348 stars · 5,086 forks · +10 stars in 24 hours · Trending score 2.18
-
2
whitecircle/halo
Halo is an open-source framework built by White Circle for training large language and multimodal models
GitHub · Python · 868 stars · 50 forks · +3 stars in 24 hours · Trending score 1.55
-
3
Lowaltitudeflight/local-llm-tuning-guide
A decision library for running local LLMs on multi-GPU machines without NVLink: parallelism, communication, quantization, speculative decoding, KV cache. Every conclusion carries its evidence grade and reproducible conditions.
GitHub · Python · 105 stars · 0 forks · 0 stars in 24 hours · Trending score 0.63
-
4
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
GitHub · Python · 41,420 stars · 4,484 forks · 0 stars in 24 hours · Trending score 0.09