GitHub · JavaScript
aws-samples/sample-genai-on-eks-starter-kit
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
- Stars
- 102
- Forks
- 64
- Stars gained in 24 hours
- +3
- Forks gained in 24 hours
- +3
Topics: agentic-ai, ai-agents, ai-engineering, ai-gateway, ai-platform, amazon-eks, aws, generative-ai, gpu-inference, kubernetes
Latest data point: Nov 20, 2026 · 102 stars · 64 forks