ai-infrastructure repositories
Trending repositories tagged ai-infrastructure, ranked by trending score. Updated daily.
-
1
bojieli/ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
GitHub · Python · 8,181 stars · 668 forks · +85 stars in 24 hours · Trending score 3.90
-
2
design-gurus/grokking-system-design
The free, open companion to the original Grokking the System Design Interview course by DesignGurus.io.
GitHub · 403 stars · 100 forks · +11 stars in 24 hours · Trending score 2.37
-
3
HarnessRouter/harnessrouter
HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.
GitHub · Python · 4,387 stars · 491 forks · +10 stars in 24 hours · Trending score 2.34
-
4
omnara-ai/omnara
The open-source managed agent platform. A self-hostable alternative to Claude Managed Agents and OpenAI's Agents API.
GitHub · Go · 3,431 stars · 273 forks · +10 stars in 24 hours · Trending score 2.08
-
5
pgrundev/pgboxdb
PGBoxDB — Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime 🐘
GitHub · Rust · 731 stars · 37 forks · +6 stars in 24 hours · Trending score 1.51
-
6
semantica-agi/semantica
Graph-Native Semantic Layer for Trustworthy Enterprise AI
GitHub · Python · 14,704 stars · 1,745 forks · 0 stars in 24 hours · Trending score 1.32
-
7
henba1/scrubjay
Recall what · where · when. Sync your AI coding agents across machines: git config-sync + a peer-to-peer transcript relay to your own NAS (or GitHub), with topic recall over MCP. Claude Code, opencode, codex.
GitHub · Shell · 18 stars · 2 forks · +5 stars in 24 hours · Trending score 1.29
-
8
hanzoai/cli
The Hanzo CLI — an AI coding agent and every product of the Hanzo cloud, in one Rust binary. curl -fsSL https://hanzo.sh | sh
GitHub · Rust · 22 stars · 18 forks · +4 stars in 24 hours · Trending score 1.20
-
9
NVIDIA/nsight-perf-sdk-for-ai
Always-on, low-overhead GPU and CUDA performance tracing SDK for AI workloads. C++ client APIs, CLI tools, open data model, Perfetto export.
GitHub · CMake · 116 stars · 9 forks · +1 stars in 24 hours · Trending score 1.19
-
10
ForceInjection/forceinjection.github.io
Github pages for Force Injection
GitHub · HTML · 104 stars · 22 forks · +2 stars in 24 hours · Trending score 1.09
-
11
mindspore-ai/hyper-parallel
A SuperPod-Affinity Training Acceleration Framework.
GitHub · Python · 217 stars · 117 forks · +1 stars in 24 hours · Trending score 1.02
-
12
Claws-ZH/awesome-ai-api
Curated list of 200+ AI API providers with daily ranking, OpenAI-compatible API checks, and live /v1/models probing for Claude, DeepSeek, Gemini, and more.
GitHub · Python · 93 stars · 54 forks · +1 stars in 24 hours · Trending score 0.94
-
13
kalibr-ai/kalibr-sdk-python
Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.
GitHub · Python · 34 stars · 3 forks · +3 stars in 24 hours · Trending score 0.91
-
14
jigjoy-ai/mozaik-network
The communication network for AI agents.
GitHub · TypeScript · 198 stars · 18 forks · 0 stars in 24 hours · Trending score 0.88
-
15
honestDS/MonoLight
MonoLight is a General Autonomous Agent runtime with IM interaction as its primary interaction modality, focusing on safe execution and human-machine collaboration.
GitHub · Python · 24 stars · 1 forks · +2 stars in 24 hours · Trending score 0.87
-
16
NVIDIA/ccluster
CCluster is an efficiency-focused, Kubernetes-native platform for managing the end-to-end AI lifecycle across distributed, multi-cloud GPU infrastructure
GitHub · Go · 12 stars · 9 forks · 0 stars in 24 hours · Trending score 0.80
-
17
10xGraph/10xGraph
Open-source, self-hosted infrastructure for AI applications. You write the agents, tools and tasks; 10xGraph runs them behind an API server with auth, role-based access, tenant isolation, durable state in Postgres and Redis, background jobs, metrics and tracing, and generates Docker and Kubernetes files. MIT. Formerly Agentflow.
GitHub · Python · 31 stars · 15 forks · +1 stars in 24 hours · Trending score 0.78
-
18
reshaprio/reshapr
The open source runtime that turns your APIs AI-Native, without rebuilding them
GitHub · Java · 180 stars · 40 forks · +1 stars in 24 hours · Trending score 0.77
-
19
iflytek/skillhub
Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.
GitHub · Java · 5,436 stars · 821 forks · −12 stars in 24 hours · Trending score 0.75
-
20
chris-page-gov/okf-explorer
Static OKF Explorer, registry, YAML-LD profile and conformance tooling for federated OKF Bundle Wikis
GitHub · TypeScript · 8 stars · 5 forks · +1 stars in 24 hours · Trending score 0.70
-
21
holon-run/holon
Open-source, local-first Rust workbench for always-on AI agents — explicit work items, event-driven wait/wake, and reliable follow-through.
GitHub · Rust · 199 stars · 19 forks · +1 stars in 24 hours · Trending score 0.69
-
22
cuihuan/awesome-ai-gateway
⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.
GitHub · HTML · 157 stars · 164 forks · 0 stars in 24 hours · Trending score 0.68
-
23
caura-ai/caura
Caura (formerly MemClaw) — governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.
GitHub · Python · 567 stars · 110 forks · 0 stars in 24 hours · Trending score 0.60
-
24
systempromptio/systemprompt-core
AI governance infrastructure for agentic systems. Rust library behind systemprompt.io — MCP, A2A, OAuth2, audit trails, compile-time extensions. Evaluate with systemprompt-template.
GitHub · Rust · 10 stars · 2 forks · +1 stars in 24 hours · Trending score 0.56