tiny-vllm repositories

Trending repositories tagged tiny-vllm, ranked by trending score. Updated daily.

  1. 1
    jmaczan/tiny-vllm

    Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

    GitHub · C++ · 1,207 stars · 107 forks · +46 stars in 24 hours · Trending score 2.83