llm-router repositories

Trending repositories tagged llm-router, ranked by trending score. Updated daily.

  1. 1
    maximhq/bifrost

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    GitHub · Go · 9,946 stars · 1,647 forks · +181 stars in 24 hours · Trending score 4.23

  2. 2
    respanai/respan-gateway

    Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

    GitHub · Rust · 993 stars · 153 forks · +24 stars in 24 hours · Trending score 3.07

  3. 3
    ClawLabsAI/free-ai-models

    Daily-updated list of free AI models (free LLM APIs), ranked by quality with live status. Plus one OpenAI-compatible endpoint that routes to the best one.

    GitHub · JavaScript · 284 stars · 30 forks · +38 stars in 24 hours · Trending score 2.74

  4. 4
    0xzr/freellmpool

    Free LLM gateway: 22 LLM providers, 178 enabled chat routes, 431 cataloged chat models; keyless start when available.

    GitHub · Python · 154 stars · 26 forks · +32 stars in 24 hours · Trending score 2.69

  5. 5
    yanstd888/9routerx

    9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.

    GitHub · Go · 264 stars · 158 forks · +4 stars in 24 hours · Trending score 2.58

  6. 6
    nejib1/Free-LLM

    74 free LLM API providers & 450+ free models (limits, no-card options) + Free-LLM Router: all of them behind one OpenAI/Anthropic-compatible endpoint with instant failover. Run Claude Code, Codex, Cursor, Aider on free models. Gemini, Groq, Mistral, DeepSeek, Qwen & more. Synced daily.

    GitHub · JavaScript · 1,085 stars · 141 forks · +14 stars in 24 hours · Trending score 2.47

  7. 7
    bestruirui/octopus

    One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

    GitHub · TypeScript · 2,750 stars · 448 forks · +28 stars in 24 hours · Trending score 2.34

  8. 8
    Continuum-AI-Corp/OrcaRouter-Lite

    Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

    GitHub · Python · 3,024 stars · 503 forks · −443 stars in 24 hours · Trending score 1.74

  9. 9
    yolorouter/yolorouter

    A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

    GitHub · Go · 402 stars · 6 forks · +2 stars in 24 hours · Trending score 1.64

  10. 10
    ai-gateways/awesome-ai-gateways

    Awesome AI gateways: open source and commercial LLM gateways, MCP gateways, agent (A2A) gateways, model routers, specs, and guides.

    GitHub · 47 stars · 38 forks · +3 stars in 24 hours · Trending score 1.36

  11. 11
    api7/aisix

    Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

    GitHub · Rust · 230 stars · 45 forks · +3 stars in 24 hours · Trending score 1.21

  12. 12
    nyroway/nyro

    Self-hosted AI Gateway — connect Claude Code, Codex, Gemini CLI and any SDK to any model provider with protocol translation.

    GitHub · Rust · 200 stars · 34 forks · +3 stars in 24 hours · Trending score 1.06

  13. 13
    pvjbuilds/delegate-router

    Claude Code and Codex CLI skill: an LLM router that delegates bulk, already-decided coding tasks to another model you already pay for (GPT via Codex, Gemini via agy, a Claude Opus subagent), on another subscription first. Benchmark-checked routes, cost per task measured on a bench, cross-model review. The host verifies every diff.

    GitHub · Python · 43 stars · 9 forks · +1 stars in 24 hours · Trending score 0.99

  14. 14
    GoSlowPoke168/openrouter-free-model-proxy

    Lightweight OpenAI-compatible proxy for OpenRouter's free models. Automatically routes to the best available free (privacy-first) model with seamless failover.

    GitHub · Python · 8 stars · 0 forks · +3 stars in 24 hours · Trending score 0.93

  15. 15
    namhv94/ezRouter

    ⚡ Ultra-fast LLM router & proxy in Rust. Multi-account quota pooling (Gemini, Codex, Claude), Token Saver engine, sub-millisecond latency & embedded Web UI.

    GitHub · Rust · 13 stars · 1 forks · +2 stars in 24 hours · Trending score 0.83

  16. 16
    malda231125/free-llm-gateway

    AI-routed gateway for free LLM APIs — reads your prompt and routes it to the best free model (Gemini, Groq, Cerebras, NVIDIA NIM, Mistral, OpenRouter, GitHub Models). OpenAI-compatible, streaming, key pooling, persistent quota tracking.

    GitHub · TypeScript · 16 stars · 3 forks · +2 stars in 24 hours · Trending score 0.82

  17. 17
    mnfst/llm-gateway

    Open Source LLM Gateway 🦚

    GitHub · TypeScript · 7,651 stars · 533 forks · 0 stars in 24 hours · Trending score 0.82

  18. 18
    LAMDA-Model-Reuse/ORBIT

    ORBIT: A Unified Toolbox for LLM Routing. Unified LLM/model routing, cost-aware inference, multimodal benchmarks, and reproducible evaluation. Accepted by Frontiers of Computer Science (2026).

    GitHub · Python · 19 stars · 1 forks · +2 stars in 24 hours · Trending score 0.72

  19. 19
    Felix-au/OmniKey-AI-Unified-Key-Manager

    A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini compatible endpoints. Routes requests dynamically across 12+ LLM platforms with automatic fallback, key scheduling, rate-limit tracking and encrypted credential storage.

    GitHub · TypeScript · 135 stars · 47 forks · +2 stars in 24 hours · Trending score 0.72

  20. 20
    zxfccmm4/magpie-remote

    为 yetone/magpie 打造的原生 iOS / iPadOS 控制中心:管理 Provider、路由、用量、会话与插件。SwiftUI · Liquid Glass · 零第三方依赖。

    GitHub · Swift · 56 stars · 8 forks · +3 stars in 24 hours · Trending score 0.71

  21. 21
    fish2lab/DSCodex

    在原版 ChatGPT / Codex 同时使用 DeepSeek V4.1 Flash 与 GPT。Local loopback router, native Responses API, full tool loops, no fork.

    GitHub · JavaScript · 54 stars · 16 forks · 0 stars in 24 hours · Trending score 0.64

  22. 22
    askalf/dario

    One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies.

    GitHub · JavaScript · 593 stars · 78 forks · +1 stars in 24 hours · Trending score 0.63

  23. 23
    cuihuan/awesome-ai-gateway

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    GitHub · HTML · 158 stars · 165 forks · 0 stars in 24 hours · Trending score 0.62

  24. 24
    giienew/9router-pro

    9Router — Pro edition of 9Router with Prompt Injection (system prompt or chat script per global / API key / model), per-key token quotas, accent themes and an optimized dashboard.

    GitHub · JavaScript · 122 stars · 24 forks · 0 stars in 24 hours · Trending score 0.60