GitHub · Python
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- Stars
- 8,153
- Forks
- 786
- Stars gained in 24 hours
- +1
- Forks gained in 24 hours
- +4
Topics: codellama, cuda-kernels, deepspeed, fastertransformer, internlm, llama, llama2, llama3, llm, llm-inference
Latest data point: Nov 21, 2026 · 8,153 stars · 786 forks