GitHub · Python
OpenBitSys/BitDecoding-FP4
Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
- Stars
- 40
- Forks
- 3
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: cuda, kv-cache-quantization, llm-inference, low-bit-quantization, vllm
Latest data point: Nov 20, 2026 · 40 stars · 3 forks