quantization-aware-training repositories

Trending repositories tagged quantization-aware-training, ranked by trending score. Updated daily.

  1. 1
    IST-DASLab/disaggregated-quantization

    Disaggregated quantization official codebase

    GitHub · Jupyter Notebook · 41 stars · 2 forks · +9 stars in 24 hours · Trending score 1.62

  2. 2
    AI-Efficiency/Awesome-Model-Quantization

    A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.

    GitHub · 2,470 stars · 246 forks · 0 stars in 24 hours · Trending score 0.85

  3. 3
    hafizradzi8901/bitnet-rwkv-lm

    From-scratch 0.15B BitNet 1.58-bit (ternary) RWKV-7 LLM trained on an 8GB GPU — QAT, 2-bit packing, RFT, local chat app.

    GitHub · Python · 10 stars · 0 forks · 0 stars in 24 hours · Trending score 0.14

  4. 4
    intel/neural-compressor

    SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

    GitHub · Python · 2,730 stars · 333 forks · 0 stars in 24 hours · Trending score 0.02