inferentia repositories

Trending repositories tagged inferentia, ranked by trending score. Updated daily.

  1. 1
    vllm-project/vllm-neuron

    Community maintained hardware plugin for vLLM on AWS Neuron

    GitHub · Python · 69 stars · 63 forks · +7 stars in 24 hours · Trending score 1.77

  2. 2
    dphnAI/sonar

    Large-scale LLM inference engine

    GitHub · Python · 1,913 stars · 212 forks · 0 stars in 24 hours · Trending score 0.19

  3. 3
    aws-solutions-library-samples/global-capacity-orchestrator-on-aws

    AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed.

    GitHub · Python · 55 stars · 11 forks · 0 stars in 24 hours · Trending score 0.10