llmops repositories

Trending repositories tagged llmops, ranked by trending score. Updated daily.

  1. 1
    BerriAI/litellm

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    GitHub · Python · 63,599 stars · 13,441 forks · +122 stars in 24 hours · Trending score 4.24

  2. 2
    langfuse/langfuse

    🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

    GitHub · TypeScript · 37,664 stars · 4,277 forks · +85 stars in 24 hours · Trending score 3.85

  3. 3
    promptfoo/promptfoo

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

    GitHub · TypeScript · 27,483 stars · 2,800 forks · +65 stars in 24 hours · Trending score 3.79

  4. 4
    respanai/respan-gateway

    Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

    GitHub · Rust · 955 stars · 145 forks · +60 stars in 24 hours · Trending score 3.57

  5. 5
    MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38

  6. 6
    mlflow/mlflow

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    GitHub · Python · 28,905 stars · 6,640 forks · +40 stars in 24 hours · Trending score 3.23

  7. 7
    ComposioHQ/composio

    Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

    GitHub · TypeScript · 31,198 stars · 4,965 forks · +39 stars in 24 hours · Trending score 3.20

  8. 8
    dataelement/bisheng

    BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration.

    GitHub · Python · 12,383 stars · 2,053 forks · +28 stars in 24 hours · Trending score 3.05

  9. 9
    Arize-ai/phoenix

    AI Observability & Evaluation

    GitHub · Python · 12,363 stars · 1,319 forks · +26 stars in 24 hours · Trending score 3.00

  10. 10
    vllm-project/vllm-ascend

    Community maintained hardware plugin for vLLM on Huawei Ascend

    GitHub · Python · 3,124 stars · 2,788 forks · +24 stars in 24 hours · Trending score 2.96

  11. 11
    yanstd888/9routerx

    9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.

    GitHub · Go · 256 stars · 158 forks · +6 stars in 24 hours · Trending score 2.74

  12. 12
    0xPlaygrounds/rig

    ⚙️🦀 Build modular and scalable LLM Applications in Rust

    GitHub · Rust · 9,192 stars · 1,026 forks · +24 stars in 24 hours · Trending score 2.69

  13. 13
    ShenSeanChen/waku-agent

    Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

    GitHub · Python · 2,205 stars · 437 forks · +25 stars in 24 hours · Trending score 2.65

  14. 14
    comet-ml/opik

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    GitHub · Java · 23,460 stars · 1,964 forks · +10 stars in 24 hours · Trending score 2.61

  15. 15
    GokuMohandas/Made-With-ML

    Learn how to develop, deploy and iterate on production-grade ML applications.

    GitHub · Jupyter Notebook · 50,097 stars · 7,824 forks · +16 stars in 24 hours · Trending score 2.19

  16. 16
    mozilla-ai/otari

    Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

    GitHub · Python · 955 stars · 138 forks · +8 stars in 24 hours · Trending score 2.10

  17. 17
    openlit/openlit

    Same agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.

    GitHub · TypeScript · 3,091 stars · 494 forks · +5 stars in 24 hours · Trending score 2.03

  18. 18
    lmnr-ai/lmnr

    Laminar - open-source observability platform purpose-built for AI agents. YC S24.

    GitHub · TypeScript · 3,510 stars · 262 forks · +8 stars in 24 hours · Trending score 1.85

  19. 19
    GetBusbar/busbar

    The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

    GitHub · Rust · 227 stars · 25 forks · +7 stars in 24 hours · Trending score 1.78

  20. 20
    Abilityai/trinity

    Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.

    GitHub · Python · 789 stars · 154 forks · +5 stars in 24 hours · Trending score 1.76

  21. 21
    Arize-ai/openinference

    OpenTelemetry Instrumentation for AI Observability

    GitHub · Python · 1,330 stars · 388 forks · +4 stars in 24 hours · Trending score 1.58

  22. 22
    future-agi/future-agi

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    GitHub · Python · 2,288 stars · 725 forks · +2 stars in 24 hours · Trending score 1.55

  23. 23
    langwatch/langwatch

    Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

    GitHub · TypeScript · 5,047 stars · 434 forks · +3 stars in 24 hours · Trending score 1.55

  24. 24
    Netflix/metaflow

    Build, Manage and Deploy AI/ML Systems

    GitHub · Python · 10,354 stars · 1,395 forks · +3 stars in 24 hours · Trending score 1.43