pipeline-parallelism repositories
Trending repositories tagged pipeline-parallelism, ranked by trending score. Updated daily.
-
1
Soulmate-Halo/heterogeneous-gpu-pd-lab
使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
GitHub · C++ · 1,291 stars · 203 forks · +8 stars in 24 hours · Trending score 2.25
-
2
deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
GitHub · Python · 43,346 stars · 5,089 forks · +10 stars in 24 hours · Trending score 2.18
-
3
joshuaswarren/omarchy-cluster
Run one local MLX model across Apple Silicon Macs on macOS and on Omarchy Linux, served as one OpenAI-compatible endpoint
GitHub · Python · 25 stars · 1 forks · 0 stars in 24 hours · Trending score 0.34
-
4
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
GitHub · Python · 41,421 stars · 4,483 forks · 0 stars in 24 hours · Trending score 0.09
-
5
yuuki-net/FreeToken-Kai
Unofficial FreeToken fork: Flash-Next 125B at 38 tok/s on two RTX 3060s with 2-bit experts, gpt-oss-120b on one; a benchmark tunes your settings. Qwen3.8-Flash-Next, 12 GB, MTP, 250k context, image input, WSL2. Runs on Turing: RTX 2060, RTX 20 series, sm_75.
GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.08
-
6
shootthesound/comfyui-mesh
Split FLUX.2 and LTX 2.3 across two GPUs (LAN or same-machine) — NVENC compresses activations live on the wire. Icarus (ComfyUI node) + Daedalus (back-half server).
GitHub · Python · 125 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00
-
7
gty111/gLLM
An Efficient and Versatile Inference Engine for Distributed LLM Serving
GitHub · Python · 74 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00
-
8
Mohit-jpg-dot/AirDrop-LLM
An offline, zero-dependency multi-node pipeline-parallel LLM inference broker. Pools heterogeneous consumer hardware (Apple Metal + NVIDIA CUDA) over ad-hoc local hotspot LANs with an integrated OpenAI-compatible API gateway.
GitHub · Rust · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00