pagedattention repositories
Trending repositories tagged pagedattention, ranked by trending score. Updated daily.
-
1
jmaczan/tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
GitHub · C++ · 1,207 stars · 107 forks · +46 stars in 24 hours · Trending score 2.83
-
2
simranjeet97/AI_Engineer_Roadmap_2027
A 10-week, staff-level curriculum and engineering roadmap focused on LLM inference systems, serving physics, custom kernels, disaggregated architectures, and production optimization.
GitHub · Jupyter Notebook · 40 stars · 5 forks · 0 stars in 24 hours · Trending score 0.57
-
3
gty111/gLLM
An Efficient and Versatile Inference Engine for Distributed LLM Serving
GitHub · Python · 74 stars · 9 forks · 0 stars in 24 hours · Trending score 0.18