semantic-cache repositories

Trending repositories tagged semantic-cache, ranked by trending score. Updated daily.

  1. 1
    maximhq/bifrost

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    GitHub · Go · 9,952 stars · 1,647 forks · +181 stars in 24 hours · Trending score 4.23

  2. 2
    yanstd888/9routerx

    9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.

    GitHub · Go · 263 stars · 158 forks · +4 stars in 24 hours · Trending score 2.58

  3. 3
    redis/redis-vl-java

    Redis Vector Library (RedisVL) -- the AI-native Java client for Redis.

    GitHub · Java · 24 stars · 5 forks · +2 stars in 24 hours · Trending score 0.82

  4. 4
    Das-rebel/a3m-router

    ⚡ Adaptive multi-model LLM router — 80+ providers, pheromone-trail failover, parallel ensemble, semantic cache. Cuts AI costs 90%. Drop-in OpenAI proxy. Self-hosted.

    GitHub · TypeScript · 18 stars · 6 forks · +1 stars in 24 hours · Trending score 0.63

  5. 5
    888newstep/ai-agent-platform

    企业级 AI Agent 平台 | Spring Boot 3 + LangChain4j | ReAct 推理 + 多路召回 RAG + 语义缓存 + 多智能体协作

    GitHub · Java · 126 stars · 6 forks · 0 stars in 24 hours · Trending score 0.45

  6. 6
    ferro-labs/ai-gateway

    Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

    GitHub · Go · 299 stars · 40 forks · 0 stars in 24 hours · Trending score 0.41

  7. 7
    redis-developer/adk-redis

    Redis integration for Google Agent Development Kit (ADK) - Memory, Sessions, Search Tools, MCP

    GitHub · Python · 32 stars · 5 forks · 0 stars in 24 hours · Trending score 0.25

  8. 8
    redis/redis-vl-python

    Redis Vector Library. The AI-native Python client for Redis.

    GitHub · Python · 437 stars · 125 forks · 0 stars in 24 hours · Trending score 0.22

  9. 9
    roedyrustam/sinapsai

    Zero-dependency In-Process AI Gateway & Control Plane for TypeScript/Node/Edge — 15 Frontier LLM Providers (OpenAI, Claude, Gemini, Qwen, Kimi, GLM, DeepSeek, Bedrock), Multi-Agent Swarm, Virtual API Keys, MCP 2025-06-18, Clustered Semantic Cache & AI SDK v5/v6

    GitHub · TypeScript · 5 stars · 3 forks · 0 stars in 24 hours · Trending score 0.10

  10. 10
    kushals256/jevcache

    MorrowCache: open-source semantic cache for OpenAI-compatible LLM APIs. Local proxy that reuses answers for paraphrased prompts and AI agent retries. npm: @kushalicious/jevcache

    GitHub · TypeScript · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  11. 11
    Rohit-Dnath/RAMen

    RAMen is a fast in-memory data store like Redis, but built for AI: drop-in Redis protocol, native vector search, semantic caching, and a built-in MCP server for agents. Single Go binary, BSD-3.

    GitHub · Go · 38 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    NaCode-Studios/Kmemo

    Kotlin Multiplatform semantic cache for LLM calls: eleven guards against false cache hits, measured on blind corpora, coroutine-first.

    GitHub · Kotlin · 8 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    brienteth/openclaw-hermes-depin

    Run OpenClaw Web Automation & Hermes AI Agents 100% Free on Your PC powered by MYCA DePIN Mesh & Zero-Cost Semantic Cache

    GitHub · JavaScript · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    shinefuer/frugent

    Cost-efficient coding-agent runtime: prefix-aware prompt-cache routing, poisoning-safe semantic cache, budgeted context compression, request batching/dedup, cascading model routing with DP-optimal policies, hard budget scheduling, span-level cost attribution, sandboxed tools, synthetic workload factory. NumPy core, CPU-only torch extra.

    GitHub · Python · 37 stars · 237 forks · 0 stars in 24 hours · Trending score 0.00