llmops repositories
Trending repositories tagged llmops, ranked by trending score. Updated daily.
-
1
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
GitHub · Python · 63,599 stars · 13,441 forks · +122 stars in 24 hours · Trending score 4.24
-
2
langfuse/langfuse
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
GitHub · TypeScript · 37,664 stars · 4,277 forks · +85 stars in 24 hours · Trending score 3.85
-
3
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
GitHub · TypeScript · 27,483 stars · 2,800 forks · +65 stars in 24 hours · Trending score 3.79
-
4
respanai/respan-gateway
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
GitHub · Rust · 955 stars · 145 forks · +60 stars in 24 hours · Trending score 3.57
-
5
MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38
-
6
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
GitHub · Python · 28,905 stars · 6,640 forks · +40 stars in 24 hours · Trending score 3.23
-
7
ComposioHQ/composio
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
GitHub · TypeScript · 31,198 stars · 4,965 forks · +39 stars in 24 hours · Trending score 3.20
-
8
dataelement/bisheng
BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration.
GitHub · Python · 12,383 stars · 2,053 forks · +28 stars in 24 hours · Trending score 3.05
-
9
Arize-ai/phoenix
AI Observability & Evaluation
GitHub · Python · 12,363 stars · 1,319 forks · +26 stars in 24 hours · Trending score 3.00
-
10
vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
GitHub · Python · 3,124 stars · 2,788 forks · +24 stars in 24 hours · Trending score 2.96
-
11
yanstd888/9routerx
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
GitHub · Go · 256 stars · 158 forks · +6 stars in 24 hours · Trending score 2.74
-
12
0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
GitHub · Rust · 9,192 stars · 1,026 forks · +24 stars in 24 hours · Trending score 2.69
-
13
ShenSeanChen/waku-agent
Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.
GitHub · Python · 2,205 stars · 437 forks · +25 stars in 24 hours · Trending score 2.65
-
14
comet-ml/opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
GitHub · Java · 23,460 stars · 1,964 forks · +10 stars in 24 hours · Trending score 2.61
-
15
GokuMohandas/Made-With-ML
Learn how to develop, deploy and iterate on production-grade ML applications.
GitHub · Jupyter Notebook · 50,097 stars · 7,824 forks · +16 stars in 24 hours · Trending score 2.19
-
16
mozilla-ai/otari
Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
GitHub · Python · 955 stars · 138 forks · +8 stars in 24 hours · Trending score 2.10
-
17
openlit/openlit
Same agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
GitHub · TypeScript · 3,091 stars · 494 forks · +5 stars in 24 hours · Trending score 2.03
-
18
lmnr-ai/lmnr
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
GitHub · TypeScript · 3,510 stars · 262 forks · +8 stars in 24 hours · Trending score 1.85
-
19
GetBusbar/busbar
The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.
GitHub · Rust · 227 stars · 25 forks · +7 stars in 24 hours · Trending score 1.78
-
20
Abilityai/trinity
Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.
GitHub · Python · 789 stars · 154 forks · +5 stars in 24 hours · Trending score 1.76
-
21
Arize-ai/openinference
OpenTelemetry Instrumentation for AI Observability
GitHub · Python · 1,330 stars · 388 forks · +4 stars in 24 hours · Trending score 1.58
-
22
future-agi/future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
GitHub · Python · 2,288 stars · 725 forks · +2 stars in 24 hours · Trending score 1.55
-
23
langwatch/langwatch
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
GitHub · TypeScript · 5,047 stars · 434 forks · +3 stars in 24 hours · Trending score 1.55
-
24
Netflix/metaflow
Build, Manage and Deploy AI/ML Systems
GitHub · Python · 10,354 stars · 1,395 forks · +3 stars in 24 hours · Trending score 1.43