GitHub · Rust

RustingStudio/RustingStrata

Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

Stars
291
Forks
36
Stars gained in 24 hours
+31
Forks gained in 24 hours
+4

Topics: anthropic-api, cuda, gguf, inference, llama-cpp, llm, local-llm, mixture-of-experts, moe, mtp

Latest data point: Nov 20, 2026 · 291 stars · 36 forks

Open on GitHub

Trending in Rust

  1. 1
    zvec-ai/zvec-grep

    Local-first search across your workspace, built for humans and AI agents.

    GitHub · Rust · 4,365 stars · 269 forks · +3 stars in 24 hours · Trending score 1.78

  2. 2
    martin-olivier/airgorah

    A WiFi security auditing software

    GitHub · Rust · 6,621 stars · 1,093 forks · +32 stars in 24 hours · Trending score 3.89

  3. 3
    nklmilojevic/sofka

    A Kubernetes TUI, reimagined in Rust - built on kube-rs and ratatui, async-first from the ground up.

    GitHub · Rust · 1,883 stars · 84 forks · +8 stars in 24 hours · Trending score 1.86

  4. 4
    openai/codex

    Lightweight coding agent that runs in your terminal

    GitHub · Rust · 135,951 stars · 21,562 forks · +226 stars in 24 hours · Trending score 4.64

  5. 5
    Kuddev/pebrel

    AI-native, GPU-accelerated terminal emulator for Windows with SSH, persistent sessions, split panes, and first-class AI CLI workflows.

    GitHub · Rust · 3,856 stars · 225 forks · +18 stars in 24 hours · Trending score 2.64

  6. 6
    CapSoftware/Cap

    Open source Loom alternative. Beautiful, shareable screen recordings.

    GitHub · Rust · 25,314 stars · 2,390 forks · +109 stars in 24 hours · Trending score 3.99