GitHub · Python
RunanywhereAI/trnrt
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
- Stars
- 1,639
- Forks
- 24
- Stars gained in 24 hours
- +31
- Forks gained in 24 hours
- +4
Topics: aws, glm, inference, llm, llm-serving, megakernels, neuron, nki, openai-api, trainium
Latest data point: Nov 20, 2026 · 1,639 stars · 24 forks