load-balancing repositories

Trending repositories tagged load-balancing, ranked by trending score. Updated daily.

  1. 1
    maximhq/bifrost

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    GitHub · Go · 9,898 stars · 1,641 forks · +98 stars in 24 hours · Trending score 3.89

  2. 2
    net-merge/net-merge

    Use all your internet connections at once on Windows, macOS, Linux and Android: per-connection load balancing over Wi-Fi, Ethernet, mobile data and phone tethers

    GitHub · Go · 3,468 stars · 198 forks · +86 stars in 24 hours · Trending score 3.67

  3. 3
    yolorouter/yolorouter

    A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

    GitHub · Go · 395 stars · 6 forks · +188 stars in 24 hours · Trending score 3.58

  4. 4
    adminsyspro/proxcenter-ui

    ProxCenter is an alternative to VMware vCenter for Proxmox environments. It provides a modern, intuitive web interface to manage multiple Proxmox VE clusters and Proxmox Backup Server instances from a single pane of glass.

    GitHub · TypeScript · 1,779 stars · 120 forks · +3 stars in 24 hours · Trending score 1.37

  5. 5
    net-merge/android

    net-merge for Android: use Wi-Fi and mobile data at the same time. No root, no account, no server.

    GitHub · Go · 24 stars · 3 forks · +2 stars in 24 hours · Trending score 1.14

  6. 6
    PegaProx/project-pegaprox

    The ultimate datacenter management solution for Proxmox VE and XCP-NG. Unified multi-cluster control, intelligent load balancing, and seamless cross-cluster VM migrations — all in one beautiful interface.

    GitHub · Python · 1,731 stars · 131 forks · 0 stars in 24 hours · Trending score 1.12

  7. 7
    cfal/tobaru

    Port forwarding utility written in Rust with IP and TLS SNI/ALPN-based forwarding rules, multiple targets per port, iptables support, and hot reloading.

    GitHub · Rust · 296 stars · 22 forks · +2 stars in 24 hours · Trending score 0.81

  8. 8
    MaskingTechnology/jitar

    Distributed runtime for JavaScript and TypeScript

    GitHub · TypeScript · 169 stars · 14 forks · +2 stars in 24 hours · Trending score 0.76

  9. 9
    stuttter/ludicrousdb

    LudicrousDB is an advanced database interface for WordPress that supports replication, failover, load balancing, & partitioning

    GitHub · PHP · 566 stars · 84 forks · +1 stars in 24 hours · Trending score 0.54

  10. 10
    drsound/polywan

    Multi-uplink failover and load balancing for Linux routers: nftables, policy routing, IPv4 and IPv6.

    GitHub · Rust · 185 stars · 19 forks · +1 stars in 24 hours · Trending score 0.45

  11. 11
    autcir/openvidia

    Multi-key proxy for NVIDIA NIM with a native desktop dashboard — auto-rotation, cooldown, RPM limiting, Claude Code + Codex CLI + opencode support. Free-tier keys pooled behind one endpoint.

    GitHub · Python · 9 stars · 1 forks · 0 stars in 24 hours · Trending score 0.41

  12. 12
    Kame696/kame-api-rotation-for-agent-zero

    🐢⚡ The best free API key rotation + automatic model fallback for Agent Zero. Many keys and models as one pool: every 429 / RESOURCE_EXHAUSTED read, each key rested exactly as long as needed, a late reply raced by your next model. Gemini, OpenAI, OpenRouter, any provider.

    GitHub · Python · 24 stars · 3 forks · 0 stars in 24 hours · Trending score 0.32

  13. 13
    kekawia/net-switch

    Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.

    GitHub · Go · 102 stars · 5 forks · 0 stars in 24 hours · Trending score 0.31

  14. 14
    HariSekhon/Diagrams-as-Code

    Cloud & DevOps Architecture Diagrams-as-Code in Python, D2 and MermaidJS languages

    GitHub · D2 · 284 stars · 56 forks · 0 stars in 24 hours · Trending score 0.30

  15. 15
    shuishuipingan/workbuddy-qoder-trae-hub

    WorkBuddy x Qoder x Trae 三引擎融合网关:一个 Python 进程跑三家引擎、一个端口(8817)对外、一把合并 Key 按模型/区域自动选路并在 401/429/502/503/504 时跨引擎故障转移;兼容 OpenAI Chat/Responses 与 Anthropic Messages(SSE 流式),合并 Key 支持模型/引擎作用域;内置 React 面板:账号池(签到/积分/出口)、模型清单、数据指标(区间/KPI/热力图/缓存命中)、请求流水、网关 Key、福利中心、设置与一键更新;MIT 开源,支持 Docker/ghcr。

    GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.24

  16. 16
    Lincoln-cn/JAiRouter

    Self-hosted LLM gateway for Java and Spring Boot teams: one OpenAI-compatible endpoint in front of Ollama, vLLM, GPUStack and cloud models, with RBAC, rate limiting, circuit breaking, audit and a visual console.

    GitHub · Java · 27 stars · 11 forks · 0 stars in 24 hours · Trending score 0.23

  17. 17
    majiayu000/litellm-rs

    Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.

    GitHub · Rust · 124 stars · 18 forks · 0 stars in 24 hours · Trending score 0.23

  18. 18
    cloudsimplus/cloudsimplus

    State-of-the-art Framework 🏗 for Cloud Computing ⛅️ Simulation: a modern, full-featured, easier-to-use, highly extensible 🧩, faster 🚀 and more accurate ☕️ Java 25+ tool for cloud computing research 🎓 Examples: https://github.com/cloudsimplus/cloudsimplus-examples

    GitHub · Java · 493 stars · 214 forks · 0 stars in 24 hours · Trending score 0.21

  19. 19
    azrtydxb/Fastllm-proxy

    The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

    GitHub · Rust · 109 stars · 93 forks · 0 stars in 24 hours · Trending score 0.17

  20. 20
    jaxernst/lasso-rpc

    Fault-tolerant Ethereum JSON-RPC proxy with intelligent, low-latency, and deeply configurable routing. Lasso gives you fine grained control to make your blockchain apps faster, cheaper, and more reliable

    GitHub · Elixir · 36 stars · 5 forks · 0 stars in 24 hours · Trending score 0.10

  21. 21
    puaicg/magpie-gptpool

    Magpie 插件:ChatGPT 多账号号池,批量导入自动换 Token,按生图额度加权轮询、失败自动换号,凭证本地加密,支持 gpt-image-2 生图与改图

    GitHub · JavaScript · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  22. 22
    k8snetworkplumbingwg/bond-cni

    Bond-cni is for fail-over and high availability of networking in cloudnative orchestration

    GitHub · Go · 77 stars · 32 forks · 0 stars in 24 hours · Trending score 0.07

  23. 23
    modcluster/mod_cluster

    mod_cluster is an intelligent native Apache httpd-based and pure-Java Undertow-based load-balancer

    GitHub · Java · 105 stars · 80 forks · 0 stars in 24 hours · Trending score 0.07

  24. 24
    himanshu231204/system-design-fundamentals

    Learn system design by breaking a real service. 16 runnable, dependency-free concept demos + one RAG API evolved through 6 stages — statelessness, caching, queues, backpressure, replicas, load balancing, observability. Every number measured, not asserted.

    GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.05