GitHub · Cuda
joris-sta/llama-cpp-pascal
Pre-tensor-core (Pascal GTX 1070) inference optimizations for llama.cpp: native Turbo3 compressed-KV flash attention, PTQ1 ternary DP4A matmuls, chunked gated-delta-net, TurboQuant/VBR KV on 80K-262K contexts
- Stars
- 22
- Forks
- 2
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: cuda, flash-attention, gtx1070, kv-cache, llama-cpp, pascal, quantization, ternary
Latest data point: Nov 20, 2026 · 22 stars · 2 forks