blackwell repositories
Trending repositories tagged blackwell, ranked by trending score. Updated daily.
-
1
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
GitHub · Python · 97,255 stars · 25,073 forks · +109 stars in 24 hours · Trending score 4.26
-
2
NVIDIA/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
GitHub · Python · 15,105 stars · 2,944 forks · +21 stars in 24 hours · Trending score 2.65
-
3
sergqwer/strata-nvfp4
Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU experts on AVX-512 or AVX2 (+AVX-VNNI), all experts in RAM from 92 GB, a low-RAM mode below, vision, W4A8 prompts. Windows / CUDA 13.
GitHub · C++ · 251 stars · 31 forks · +23 stars in 24 hours · Trending score 2.42
-
4
lightseekorg/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
GitHub · Python · 2,944 stars · 422 forks · +10 stars in 24 hours · Trending score 2.18
-
5
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
GitHub · Python · 38,872 stars · 10,647 forks · −123 stars in 24 hours · Trending score 1.80
-
6
xl03-bit/sm120-nvfp4-training
Faster, more memory-efficient NVFP4 training
GitHub · Python · 111 stars · 13 forks · +6 stars in 24 hours · Trending score 1.62
-
7
NVIDIA/cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
GitHub · Cuda · 1,007 stars · 340 forks · +3 stars in 24 hours · Trending score 1.47
-
8
kacper-daftcode/vLLM-Moet
Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0
GitHub · Sass · 579 stars · 49 forks · +7 stars in 24 hours · Trending score 1.44
-
9
gpillon/ignis
An inference engine for one NVIDIA RTX card, built for a coding agent and its subagents, and a companion that listens, reads and draws: Qwen3.8 27B and 125B Flash-Next MoE, Qwen-Image-2.1, Qwen3-ASR on the CPU. OpenAI-compatible API and Playground in one binary.
GitHub · Rust · 67 stars · 9 forks · +1 stars in 24 hours · Trending score 0.72
-
10
avifenesh/memra
Memra is a Rust + CUDA LLM inference engine with hand-written kernels, NVFP4 and mixed-precision execution, and correctness gates scoped to each model and GPU
GitHub · Rust · 7 stars · 1 forks · +1 stars in 24 hours · Trending score 0.63
-
11
hzX40000000/SFU-Sim
Bit-exact NVIDIA MUFU/SFU model, exhaustively verified on A100, Ada and Blackwell GPUs.
GitHub · C++ · 10 stars · 1 forks · 0 stars in 24 hours · Trending score 0.50
-
12
MerkyorLynn/lynn-engine
Lynn 原生 LLM 推理引擎 · W4A8/NVFP4 量化 · 自写 CUDA/Triton kernel · MoE · 投机解码 | Lynn-native LLM inference engine for NVIDIA Blackwell
GitHub · Python · 28 stars · 0 forks · 0 stars in 24 hours · Trending score 0.48
-
13
DamianKA1993/blackwell-egpu-manager
Dynamic PCIe Gen4/Gen5 retrainer, clock stabilization & state manager for NVIDIA Blackwell (RTX 50xx) eGPUs on Linux (KDE Plasma 6).
GitHub · Shell · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.32
-
14
timothystewart6/ubuntu-gb10
Ubuntu 24.04 + NVIDIA stack setup guide for GB10 / DGX Spark systems
GitHub · Jinja · 26 stars · 5 forks · 0 stars in 24 hours · Trending score 0.14
-
15
kekzl/imp
Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.
GitHub · C++ · 79 stars · 6 forks · −4 stars in 24 hours · Trending score 0.10
-
16
truespar/paddock
Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
GitHub · Rust · 164 stars · 25 forks · 0 stars in 24 hours · Trending score 0.08
-
17
AEON-7/comfyui-aeon-spark
Bleeding-edge ComfyUI for NVIDIA DGX Spark (GB10/Blackwell/sm_121a). CUDA 13 + SageAttention v3 (sm_121a) + NVFP4 + 14 custom-node packs + Flux 2 Dev / LTX 2.3 22B / ACE-Step v1.5 XL Turbo pre-bundled with abliterated text-encoder paths.
GitHub · Shell · 90 stars · 18 forks · 0 stars in 24 hours · Trending score 0.05
-
18
hanxiao/DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000
Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21, DSpark + FLy verification and top_p 1.0: 463 tok/s single-stream agent decode at 30k-120k context, 1082 tok/s over 8 streams, 1M context, Flex-start GCE VM
GitHub · Python · 57 stars · 10 forks · 0 stars in 24 hours · Trending score 0.04
-
19
GoBrrr-ai/mjolnir
Mjölnir — faster, bigger-context LLM serving on edge GPUs: a dedicated decode kernel per platform, a tuned vLLM image that carries every kernel, and a CLI that serves, benchmarks and documents it.
GitHub · Python · 12 stars · 4 forks · 0 stars in 24 hours · Trending score 0.04
-
20
openlake-project/openlake
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
GitHub · Rust · 3,094 stars · 421 forks · 0 stars in 24 hours · Trending score 0.04
-
21
actypedef/ARCQuant
[ACL 2026 Main] Code for the paper "ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs"
GitHub · Cuda · 35 stars · 9 forks · 0 stars in 24 hours · Trending score 0.04
-
22
xilla420/dlss5-wow-sidecar
DLSS 5 Neural Rendering for World of Warcraft (WoW) on NVIDIA RTX 40/50 — a safe overlay with no DLL injection, no hooks and no ReShade next to Wow.exe. Free and open source.
GitHub · C++ · 38 stars · 11 forks · 0 stars in 24 hours · Trending score 0.04
-
23
amasu/dgx-spark-qwen38
Docker compose configs for serving Qwen3.8-27B on a DGX Spark (GB10): vLLM+MTP current, SGLang+DSPARK + FP8 rollback stacks
GitHub · Shell · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.03
-
24
bidual/awesome-dgx-spark
A curated list of tools, guides, playbooks, and resources for the NVIDIA DGX Spark (GB10 Grace Blackwell personal AI supercomputer).
GitHub · Shell · 97 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00