inference-api repositories
Trending repositories tagged inference-api, ranked by trending score. Updated daily.
-
1
roboflow/inference
Turn any computer or edge device into a command center for your computer vision projects.
GitHub · Python · 2,499 stars · 342 forks · +1 stars in 24 hours · Trending score 0.92
-
2
inference-gateway/inference-gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
GitHub · Go · 210 stars · 46 forks · +2 stars in 24 hours · Trending score 0.58
-
3
qualcomm/ai-hub-models
Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
GitHub · Python · 1,265 stars · 221 forks · 0 stars in 24 hours · Trending score 0.50
-
4
basetenlabs/truss
The simplest way to serve AI/ML models in production
GitHub · Python · 1,236 stars · 143 forks · −1 stars in 24 hours · Trending score 0.37
-
5
mxxm-t/llmx
Dependency-free C++ LLM inference runtime written from scratch: CPU, Vulkan, ROCm and CUDA backends, GGUF and safetensors models, layer and tensor split across GPUs, and an OpenAI-compatible multi-user server.
GitHub · C++ · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
6
ai-gateways/awesome-free-ai-providers
Free tiers, free models, and signup credits from hosted AI model APIs, with limits, requirements, and data-use terms sourced from each provider's own pages.
GitHub · 9 stars · 4 forks · 0 stars in 24 hours · Trending score 0.10
-
7
TommyLemon/CVAuto
👁 零代码零标注 CV AI 自动化测试工具 🚀 免除大量人工画框和打标签等,直接零代码快速自动化测试 CV 计算机视觉 AI 人工智能图像识别算法:行人检测、动植物分类、人脸识别、OCR 车牌识别、旋转校正、舞蹈姿态、抠图分割 等,还可一键 下载测试报告、导出训练和测试数据集
GitHub · JavaScript · 44 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00