GitHub · Python
ModelTC/LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
- Stars
- 4,368
- Forks
- 389
- Stars gained in 24 hours
- +4
- Forks gained in 24 hours
- 0
Topics: deep-learning, gpt, llama, llm, model-serving, nlp, openai-triton
Latest data point: Nov 21, 2026 · 4,368 stars · 389 forks