GitHub · Python
alibaba/rtp-llm
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
- Stars
- 1,403
- Forks
- 307
- Stars gained in 24 hours
- +1
- Forks gained in 24 hours
- +1
Topics: gpt, inference, llama, llm, llm-serving, llmops, model-serving
Latest data point: Nov 20, 2026 · 1,403 stars · 307 forks