GitHub · C++
Brontir/NInferno
High-performance single-GPU inference for (Qwen, Gemma, Nemotron & other) checkpoints and GPUs.
- Stars
- 8
- Forks
- 0
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: cuda, inference, inference-engine, inference-optimization
Latest data point: Nov 21, 2026 · 8 stars · 0 forks