post-training-quantization repositories
Trending repositories tagged post-training-quantization, ranked by trending score. Updated daily.
-
1
IST-DASLab/GSQ
Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).
GitHub · Python · 143 stars · 21 forks · 0 stars in 24 hours · Trending score 1.38
-
2
AI-Efficiency/Awesome-Model-Quantization
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
GitHub · 2,470 stars · 246 forks · 0 stars in 24 hours · Trending score 0.86
-
3
pjmalandrino/llvq
Tetra : Leech lattice vector quantization for 2-bit LLM weights, in Rust, with a fused multi-shell CUDA decoder.
GitHub · Rust · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.18
-
4
intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
GitHub · Python · 2,730 stars · 333 forks · 0 stars in 24 hours · Trending score 0.03
-
5
Dreamer-Toby/STEPQuant
STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization
GitHub · Python · 102 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00