GitHub · Python
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- Stars
- 12,610
- Forks
- 853
- Stars gained in 24 hours
- +49
- Forks gained in 24 hours
- −162
Topics: llm, llmops, model-inference, fine-tuning, llm-serving, llama, vicuna, bentoml, llama2, llm-inference
Latest data point: Nov 22, 2026 · 12,610 stars · 853 forks