llm-gateway repositories
Trending repositories tagged llm-gateway, ranked by trending score. Updated daily.
-
1
cheaper-inference/OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
GitHub · TypeScript · 89,545 stars · 13,849 forks · +479 stars in 24 hours · Trending score 5.28
-
2
maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
GitHub · Go · 9,946 stars · 1,647 forks · +181 stars in 24 hours · Trending score 4.23
-
3
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
GitHub · Python · 63,702 stars · 13,473 forks · +115 stars in 24 hours · Trending score 4.20
-
4
zexadev/gemini-web2api-go
Gemini web → OpenAI-compatible + native Gemini API, self-hosted, no API key. Gemini 4 Argon from a paid account cookie, strict_model (429 instead of a silent downgrade), cookie pool with auto-renewal, proxy pool, admin panel, image & video generation, single Go binary · 把 Gemini 网页反代成 OpenAI 兼容 / Gemini 原生 API,付费号 cookie 直接用 4 Argon
GitHub · Go · 983 stars · 191 forks · +212 stars in 24 hours · Trending score 4.12
-
5
QuantumNous/new-api
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
GitHub · Go · 52,341 stars · 12,796 forks · +87 stars in 24 hours · Trending score 3.99
-
6
decolua/9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
GitHub · JavaScript · 32,736 stars · 6,421 forks · +69 stars in 24 hours · Trending score 3.77
-
7
langfuse/langfuse
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
GitHub · TypeScript · 37,723 stars · 4,291 forks · +66 stars in 24 hours · Trending score 3.71
-
8
respanai/respan-gateway
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
GitHub · Rust · 993 stars · 153 forks · +24 stars in 24 hours · Trending score 3.07
-
9
ShawTim/gemini-app2api
Zero-dependency native Gemini HTTP/2 gateway & in-process Pi extension (pi-gemini-app) connecting Gemini subscriptions to OpenAI-compatible coding agents (Cursor, Cline, Codex, Pi) with multi-account pooling.
GitHub · JavaScript · 90 stars · 14 forks · +31 stars in 24 hours · Trending score 2.89
-
10
0xzr/freellmpool
Free LLM gateway: 22 LLM providers, 178 enabled chat routes, 431 cataloged chat models; keyless start when available.
GitHub · Python · 154 stars · 26 forks · +32 stars in 24 hours · Trending score 2.69
-
11
apimartukq9od/llm-gateway-playground
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
GitHub · Python · 82 stars · 0 forks · +45 stars in 24 hours · Trending score 2.68
-
12
yanstd888/9routerx
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
GitHub · Go · 264 stars · 158 forks · +4 stars in 24 hours · Trending score 2.58
-
13
WncFht/devin2api
Devin upstream → OpenAI Responses / Anthropic Messages compatible API proxy
GitHub · Go · 71 stars · 13 forks · +23 stars in 24 hours · Trending score 2.43
-
14
bestruirui/octopus
One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关
GitHub · TypeScript · 2,750 stars · 448 forks · +28 stars in 24 hours · Trending score 2.34
-
15
yreidev/workbuddy2api-panel
把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。
GitHub · Go · 130 stars · 29 forks · +8 stars in 24 hours · Trending score 2.33
-
16
Yinglianchun/Serein
雨落下的地方,记忆会再次开花。可自部署的 AI 长期记忆与聊天网关。Self-hosted AI memory & chat gateway for long-term conversations.
GitHub · Python · 256 stars · 62 forks · +21 stars in 24 hours · Trending score 2.30
-
17
katanemo/plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
GitHub · Rust · 7,118 stars · 499 forks · +19 stars in 24 hours · Trending score 2.28
-
18
apimarthxrsd/llm-gateway-quickstart
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
GitHub · Python · 72 stars · 0 forks · +20 stars in 24 hours · Trending score 2.10
-
19
LAGcomcom/zen-gate
把 OpenCode Zen 免费模型装进你所有的 AI Agent —— Windows 托盘网关,OpenAI/Anthropic 兼容,自动适配 10+ Agent,限流自动切换
GitHub · Go · 306 stars · 48 forks · +15 stars in 24 hours · Trending score 2.00
-
20
Ianzhyh/workbuddy-to-dsh
把本机 WorkBuddy 桌面端已登录的模型(DeepSeek / GLM / Kimi / MiniMax 等)变成本地的 OpenAI 与 Anthropic 兼容接口 —— Claude Code / opencode / Cursor / Trae / Cherry Studio / LobeChat 等任意支持自定义 Base URL 的客户端可直连。附网页控制台与 DeepSeek Harness 原生插件。零依赖,仅监听 127.0.0.1。
GitHub · JavaScript · 89 stars · 15 forks · +11 stars in 24 hours · Trending score 1.98
-
21
mozilla-ai/otari
Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
GitHub · Python · 960 stars · 141 forks · +6 stars in 24 hours · Trending score 1.98
-
22
tbphp/gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
GitHub · Go · 7,244 stars · 795 forks · +13 stars in 24 hours · Trending score 1.96
-
23
Kong/kong
🦍 The API and AI Gateway
GitHub · Lua · 44,403 stars · 5,248 forks · +6 stars in 24 hours · Trending score 1.89
-
24
yolorouter/yolorouter
A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.
GitHub · Go · 402 stars · 6 forks · +2 stars in 24 hours · Trending score 1.64