GitHub · Cuda

joris-sta/llama-cpp-pascal

Pre-tensor-core (Pascal GTX 1070) inference optimizations for llama.cpp: native Turbo3 compressed-KV flash attention, PTQ1 ternary DP4A matmuls, chunked gated-delta-net, TurboQuant/VBR KV on 80K-262K contexts

Stars
22
Forks
2
Stars gained in 24 hours
0
Forks gained in 24 hours
0

Topics: cuda, flash-attention, gtx1070, kv-cache, llama-cpp, pascal, quantization, ternary

Latest data point: Nov 20, 2026 · 22 stars · 2 forks

Open on GitHub