llm-ops repositories
Trending repositories tagged llm-ops, ranked by trending score. Updated daily.
-
1
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
GitHub · Python · 12,610 stars · 853 forks · +49 stars in 24 hours · Trending score 2.61
-
2
ultracontext/ultracontext
Open Source Context infrastructure for AI agents. Auto-capture and share your agents' context everywhere.
GitHub · JavaScript · 443 stars · 40 forks · +21 stars in 24 hours · Trending score 2.24
-
3
Kong/kong
🦍 The API and AI Gateway
GitHub · Lua · 44,404 stars · 5,248 forks · +6 stars in 24 hours · Trending score 1.89
-
4
langwatch/langwatch
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
GitHub · TypeScript · 5,051 stars · 432 forks · +6 stars in 24 hours · Trending score 1.80
-
5
TykTechnologies/tyk
Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
GitHub · Go · 10,899 stars · 1,172 forks · +3 stars in 24 hours · Trending score 1.42
-
6
ai-sdlc-framework/ai-sdlc
Declarative governance framework for AI-augmented software development lifecycles
GitHub · TypeScript · 451 stars · 81 forks · +3 stars in 24 hours · Trending score 1.34
-
7
Chleba/ollamaMQ
High-performance LLM backends proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.
GitHub · Rust · 132 stars · 16 forks · +2 stars in 24 hours · Trending score 0.72
-
8
bytebeast/check-endpoint
Live per-phase HTTP timing probe: DNS, TCP, TLS, TTFB, body transfer, and streaming chunk timing (ITL), streamed as each phase completes.
GitHub · Python · 9 stars · 3 forks · +1 stars in 24 hours · Trending score 0.54
-
9
iflytek/astron-agent
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
GitHub · Java · 8,923 stars · 913 forks · −17 stars in 24 hours · Trending score 0.53
-
10
ucsandman/claude-harness
The Claude Code harness I run every day, published under this name since day one and now the same repository as ucsandman/Agnostic-AI: guard hooks, rules, context modules, Mods, subagents, workflows, tools and jobs, ported to 20 clients. Zero-dependency Node.
GitHub · JavaScript · 32 stars · 2 forks · +1 stars in 24 hours · Trending score 0.46
-
11
sherifican/Agent-FleetOps
Operational tooling & discipline for multi-agent AI engineering fleets — mutation-proven guards, a Textual terminal monitor, generalized skills, and specs. Every check ships with proof it can fail.
GitHub · Python · 35 stars · 0 forks · +1 stars in 24 hours · Trending score 0.45
-
12
EmbeddedLLM/JamAIBase
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.
GitHub · Python · 1,104 stars · 48 forks · 0 stars in 24 hours · Trending score 0.29
-
13
TaimoorKhan10/replayd
Turn failed AI agent runs into replayable regression tests. Catch regressions before you ship.
GitHub · Python · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.28
-
14
Jwuthri/Tracely-ai
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
GitHub · Python · 1,299 stars · 131 forks · 0 stars in 24 hours · Trending score 0.07
-
15
VibOpsai/vibops-mcp
117 MCP tools for GPU infrastructure + Agent FinOps — deploy LLMs, manage VMs (Proxmox/XO/vSphere), track cost per agent, enforce budgets and model policies. Works with Claude, Cursor, n8n, LangChain
GitHub · Python · 20 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
16
monaccode/astromesh
Multi-model AI agent runtime. Define agents in YAML, route each role to a model, orchestrate with 7 patterns (ReAct, Plan & Execute, Fan-Out, Pipeline, Supervisor, Swarm, Glyph), and deploy as a REST/WebSocket API with RAG, memory, MCP tools, guardrails and OpenTelemetry observability.
GitHub · Python · 39 stars · 9 forks · 0 stars in 24 hours · Trending score 0.04
-
17
AcruxCore/AcruxCore
Open-source LLMOps platform with prompt management, an OpenAI-compatible AI gateway, OpenTelemetry tracing, a versioned tool catalog, and LLM evaluation. Use hosted or self-host with TypeScript and Python SDKs.
GitHub · TypeScript · 14 stars · 1 forks · 0 stars in 24 hours · Trending score 0.04
-
18
hermes-labs-ai/lintlang
Static analysis for AI agent configs, tool descriptions, and system prompts — catches vague tool descriptions, missing stop conditions, and schema gaps before they reach runtime. Zero-LLM, deterministic checks, built for CI.
GitHub · Python · 147 stars · 13 forks · 0 stars in 24 hours · Trending score 0.01
-
19
Emmimal/control-layer
A production-grade control layer that sits between your application logic and any LLM — input validation, schema enforcement, circuit breaking, targeted retry, and audit logging in one composable pipeline.
GitHub · Python · 62 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00
-
20
ray-aqno/Toto-Wolff
Persistent AI governance for Claude Code — three-tier council deliberation, P10 pre-execution plans, and deterministic confidence scoring grounded in your own past decisions.
GitHub · TypeScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00