inference-api repositories

Trending repositories tagged inference-api, ranked by trending score. Updated daily.

  1. 1
    roboflow/inference

    Turn any computer or edge device into a command center for your computer vision projects.

    GitHub · Python · 2,499 stars · 342 forks · +1 stars in 24 hours · Trending score 0.92

  2. 2
    inference-gateway/inference-gateway

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    GitHub · Go · 210 stars · 46 forks · +2 stars in 24 hours · Trending score 0.58

  3. 3
    qualcomm/ai-hub-models

    Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

    GitHub · Python · 1,265 stars · 221 forks · 0 stars in 24 hours · Trending score 0.50

  4. 4
    basetenlabs/truss

    The simplest way to serve AI/ML models in production

    GitHub · Python · 1,236 stars · 143 forks · −1 stars in 24 hours · Trending score 0.37

  5. 5
    mxxm-t/llmx

    Dependency-free C++ LLM inference runtime written from scratch: CPU, Vulkan, ROCm and CUDA backends, GGUF and safetensors models, layer and tensor split across GPUs, and an OpenAI-compatible multi-user server.

    GitHub · C++ · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  6. 6
    ai-gateways/awesome-free-ai-providers

    Free tiers, free models, and signup credits from hosted AI model APIs, with limits, requirements, and data-use terms sourced from each provider's own pages.

    GitHub · 9 stars · 4 forks · 0 stars in 24 hours · Trending score 0.10

  7. 7
    TommyLemon/CVAuto

    👁 零代码零标注 CV AI 自动化测试工具 🚀 免除大量人工画框和打标签等,直接零代码快速自动化测试 CV 计算机视觉 AI 人工智能图像识别算法:行人检测、动植物分类、人脸识别、OCR 车牌识别、旋转校正、舞蹈姿态、抠图分割 等,还可一键 下载测试报告、导出训练和测试数据集

    GitHub · JavaScript · 44 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00