tiny-vllm repositories
Trending repositories tagged tiny-vllm, ranked by trending score. Updated daily.
-
1
jmaczan/tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
GitHub · C++ · 1,207 stars · 107 forks · +46 stars in 24 hours · Trending score 2.83