llm-server repositories
Trending repositories tagged llm-server, ranked by trending score. Updated daily.
-
1
Quazmoz/InferBridge
Windows-first OpenAI-compatible local LLM server powered by OpenVINO GenAI for Intel CPU/GPU/NPU, with chat UI, model conversion, and setup scripts.
GitHub · Python · 56 stars · 3 forks · +5 stars in 24 hours · Trending score 1.23
-
2
wannaphong/android-hostai
HostAI - Android LLM API Server
GitHub · Kotlin · 37 stars · 6 forks · 0 stars in 24 hours · Trending score 0.36