ai-gateway repositories

Trending repositories tagged ai-gateway, ranked by trending score. Updated daily.

  1. 1
    cheaper-inference/OmniRoute

    Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

    GitHub · TypeScript · 89,545 stars · 13,849 forks · +479 stars in 24 hours · Trending score 5.28

  2. 2
    maximhq/bifrost

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    GitHub · Go · 9,946 stars · 1,647 forks · +181 stars in 24 hours · Trending score 4.23

  3. 3
    BerriAI/litellm

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    GitHub · Python · 63,702 stars · 13,473 forks · +115 stars in 24 hours · Trending score 4.20

  4. 4
    QuantumNous/new-api

    Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

    GitHub · Go · 52,341 stars · 12,796 forks · +87 stars in 24 hours · Trending score 3.99

  5. 5
    decolua/9router

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

    GitHub · JavaScript · 32,736 stars · 6,421 forks · +69 stars in 24 hours · Trending score 3.77

  6. 6
    langfuse/langfuse

    🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

    GitHub · TypeScript · 37,723 stars · 4,291 forks · +66 stars in 24 hours · Trending score 3.71

  7. 7
    lidge-jun/opencodex

    Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code

    GitHub · TypeScript · 18,704 stars · 1,542 forks · +31 stars in 24 hours · Trending score 3.31

  8. 8
    agentgateway/agentgateway

    Next Generation Agentic Proxy for AI Agents and MCP servers

    GitHub · Rust · 6,355 stars · 1,124 forks · +41 stars in 24 hours · Trending score 3.30

  9. 9
    fosrl/pangolin

    Modern networking and security platform providing secure access and connectivity to apps, infrastructure, and AI workloads. Connect and protect your users.

    GitHub · TypeScript · 23,934 stars · 856 forks · +38 stars in 24 hours · Trending score 3.21

  10. 10
    routerhubSI/uncensored-models

    The uncensored model library — every uncensored and abliterated model, what it does, free open weights on Hugging Face and hosted API access, in one index. Maintained by RouterHub.

    GitHub · 217 stars · 68 forks · +63 stars in 24 hours · Trending score 3.09

  11. 11
    respanai/respan-gateway

    Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

    GitHub · Rust · 993 stars · 153 forks · +24 stars in 24 hours · Trending score 3.07

  12. 12
    routerhubSI/kimi-uncensored

    Every uncensored and abliterated Kimi build — Kimi K3.1 Pro Uncensored via API at 0.30/1.50 USD per million tokens, abliterated open-weight checkpoints for K3.1 Pro and K3, license notes and a red-team prompt library. Maintained by RouterHub.

    GitHub · 123 stars · 19 forks · +39 stars in 24 hours · Trending score 2.74

  13. 13
    casdoor/casdoor

    An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

    GitHub · Go · 14,924 stars · 1,931 forks · +15 stars in 24 hours · Trending score 2.72

  14. 14
    yanstd888/9routerx

    9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.

    GitHub · Go · 264 stars · 158 forks · +4 stars in 24 hours · Trending score 2.58

  15. 15
    Doulor/DoulorCloud

    Doulor Cloud —— 一站式云端资源分发平台:二级域名 / 域名邮箱 / R2 直链网盘 / 个人名片 / AI API 中转站。纯静态前端 + Cloudflare Workers + D1 + R2。

    GitHub · TypeScript · 283 stars · 13 forks · +38 stars in 24 hours · Trending score 2.48

  16. 16
    nejib1/Free-LLM

    74 free LLM API providers & 450+ free models (limits, no-card options) + Free-LLM Router: all of them behind one OpenAI/Anthropic-compatible endpoint with instant failover. Run Claude Code, Codex, Cursor, Aider on free models. Gemini, Groq, Mistral, DeepSeek, Qwen & more. Synced daily.

    GitHub · JavaScript · 1,085 stars · 141 forks · +14 stars in 24 hours · Trending score 2.47

  17. 17
    apache/apisix

    The Cloud-Native API Gateway and AI Gateway

    GitHub · Lua · 17,359 stars · 3,017 forks · +14 stars in 24 hours · Trending score 2.40

  18. 18
    WizisCool/oh-my-cpa

    Modern web console for CLIProxyAPI v8+ with provider and OAuth management, live routing, request analytics, pricing, and MCP.

    GitHub · TypeScript · 479 stars · 54 forks · +9 stars in 24 hours · Trending score 2.36

  19. 19
    bestruirui/octopus

    One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

    GitHub · TypeScript · 2,750 stars · 448 forks · +28 stars in 24 hours · Trending score 2.34

  20. 20
    yreidev/workbuddy2api-panel

    把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。

    GitHub · Go · 130 stars · 29 forks · +8 stars in 24 hours · Trending score 2.33

  21. 21
    Yinglianchun/Serein

    雨落下的地方,记忆会再次开花。可自部署的 AI 长期记忆与聊天网关。Self-hosted AI memory & chat gateway for long-term conversations.

    GitHub · Python · 256 stars · 62 forks · +21 stars in 24 hours · Trending score 2.30

  22. 22
    katanemo/plano

    Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

    GitHub · Rust · 7,118 stars · 499 forks · +19 stars in 24 hours · Trending score 2.28

  23. 23
    yqing004-boop/magpie-android

    magpie手机端 非官方 magpie Android 客户端:无需 Root 在手机上运行本地 AI 网关,支持 App 内更新内核、局域网共享与 Material 3 界面

    GitHub · Java · 49 stars · 6 forks · +13 stars in 24 hours · Trending score 2.17

  24. 24
    apimartnxych9/ai-gateway-benchmark

    AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

    GitHub · Python · 76 stars · 0 forks · +22 stars in 24 hours · Trending score 2.16