ssd-streaming repositories

Trending repositories tagged ssd-streaming, ranked by trending score. Updated daily.

  1. 1
    yanun0323/Whallm

    DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook

    GitHub · Python · 151 stars · 18 forks · +26 stars in 24 hours · Trending score 2.35

  2. 2
    1picassoai/kraits

    Run stock llama.cpp with large MoE models like Qwen3.8-Flash-Next (91 GB, 4-bit) on a 16 GB Mac.

    GitHub · Rust · 20 stars · 1 forks · +5 stars in 24 hours · Trending score 1.32

  3. 3
    Ninnix/q36

    Qwen3.8-27B and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal

    GitHub · C · 87 stars · 10 forks · +4 stars in 24 hours · Trending score 1.23

  4. 4
    outerreaches/moonshine

    Run the official Kimi K3 MoE checkpoint on one 128 GB AMD Strix Halo box. ROCm-resident static weights, MXFP4 experts streamed from NVMe via io_uring. C engine, chat client, OpenAI-compatible server. Very experimental.

    GitHub · C · 9 stars · 0 forks · +2 stars in 24 hours · Trending score 0.73

  5. 5
    srcterm/streamlx

    Fast and lightweight SSD-streaming engine for MoE models on Apple Silicon with MLX

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.19