inference-acceleration repositories
Trending repositories tagged inference-acceleration, ranked by trending score. Updated daily.
-
1
AlibabaResearch/SparkDiffusion
SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.
GitHub · Python · 749 stars · 84 forks · +229 stars in 24 hours · Trending score 3.86
-
2
MicroPerceptron/virtio-accel
Transport-neutral, vendor-agnostic virtual accelerator devices. First class cross-platform NPU backend support for Apple, Intel, AMD, Qualcomm devices, as well as Vulkan for cross-platform GPU support.
GitHub · Rust · 24 stars · 3 forks · +6 stars in 24 hours · Trending score 1.58
-
3
redhat-performance/configiq
Distributed inference configuration tools
GitHub · TypeScript · 23 stars · 13 forks · 0 stars in 24 hours · Trending score 0.09
-
4
Generated-Computers/Locals
Run many AI agents at once on your Mac, up to 3x faster.
GitHub · Python · 538 stars · 43 forks · −113 stars in 24 hours · Trending score 0.08
-
5
MessiX77/Awesome-Efficient-dLLMs
[EMNLP 2026] 📚 A curated list of Awesome Efficient dLLMs Papers with Codes
GitHub · 147 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00
-
6
Eshamont/OCGQuant
[EMNLP 2026] Code for the paper "OCGQuant: Outlier-Companion Grouping for NVFP4 Quantization"
GitHub · Cuda · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
7
sepiablue-ai/ComfyUI-H3-X2-Stream
ComfyUI nodes for MiniMax H3: INT8 X2 VAE and asynchronous NVENC saving. 5-second 1088x1920 video with audio in about 60 s on an RTX 4070 12GB, about 30% faster than the FP16 X2 VAE.
GitHub · Python · 38 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
8
jitllm/jitllm
Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory
GitHub · Go · 58 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00