pipeline-parallelism repositories

Trending repositories tagged pipeline-parallelism, ranked by trending score. Updated daily.

  1. 1
    Soulmate-Halo/heterogeneous-gpu-pd-lab

    使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。

    GitHub · C++ · 1,291 stars · 203 forks · +8 stars in 24 hours · Trending score 2.25

  2. 2
    deepspeedai/DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    GitHub · Python · 43,346 stars · 5,089 forks · +10 stars in 24 hours · Trending score 2.18

  3. 3
    joshuaswarren/omarchy-cluster

    Run one local MLX model across Apple Silicon Macs on macOS and on Omarchy Linux, served as one OpenAI-compatible endpoint

    GitHub · Python · 25 stars · 1 forks · 0 stars in 24 hours · Trending score 0.34

  4. 4
    hpcaitech/ColossalAI

    Making large AI models cheaper, faster and more accessible

    GitHub · Python · 41,421 stars · 4,483 forks · 0 stars in 24 hours · Trending score 0.09

  5. 5
    yuuki-net/FreeToken-Kai

    Unofficial FreeToken fork: Flash-Next 125B at 38 tok/s on two RTX 3060s with 2-bit experts, gpt-oss-120b on one; a benchmark tunes your settings. Qwen3.8-Flash-Next, 12 GB, MTP, 250k context, image input, WSL2. Runs on Turing: RTX 2060, RTX 20 series, sm_75.

    GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.08

  6. 6
    shootthesound/comfyui-mesh

    Split FLUX.2 and LTX 2.3 across two GPUs (LAN or same-machine) — NVENC compresses activations live on the wire. Icarus (ComfyUI node) + Daedalus (back-half server).

    GitHub · Python · 125 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00

  7. 7
    gty111/gLLM

    An Efficient and Versatile Inference Engine for Distributed LLM Serving

    GitHub · Python · 74 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    Mohit-jpg-dot/AirDrop-LLM

    An offline, zero-dependency multi-node pipeline-parallel LLM inference broker. Pools heterogeneous consumer hardware (Apple Metal + NVIDIA CUDA) over ad-hoc local hotspot LANs with an integrated OpenAI-compatible API gateway.

    GitHub · Rust · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00