local-llm repositories

Trending repositories tagged local-llm, ranked by trending score. Updated daily.

  1. 1
    simplexai-labs/linger

    Linger is An Open-Source Personal Agent That Runs Fully on Your PC. We aim to break Big Tech’s grip on AI by bringing powerful local AI to everyday computers through efficient model–harness co-design, so everyone can run their own.

    GitHub · TypeScript · 2,388 stars · 205 forks · +1,163 stars in 24 hours · Trending score 5.63

  2. 2
    sgaofen/humanizer-local-model

    Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

    GitHub · Python · 1,001 stars · 163 forks · +625 stars in 24 hours · Trending score 4.98

  3. 3
    PurpleDoubleD/locally-uncensored

    The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

    GitHub · TypeScript · 4,405 stars · 714 forks · +55 stars in 24 hours · Trending score 3.91

  4. 4
    hyperionaidev/smolmaxxing

    maxxing the ability to run different LLMs on the smallest devices possible

    GitHub · C · 1,035 stars · 54 forks · +65 stars in 24 hours · Trending score 3.88

  5. 5
    ASCIT31/Dark-Moon

    Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.

    GitHub · Python · 1,274 stars · 222 forks · +121 stars in 24 hours · Trending score 3.67

  6. 6
    AienTech/dossier

    A self-hosted job search and resume builder app that writes tailored resumes and cover letters from your profile.

    GitHub · TypeScript · 5,322 stars · 1,105 forks · +57 stars in 24 hours · Trending score 3.64

  7. 7
    mw00/project-maya

    Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash (220B) on your own GPUs - from 8 GB of VRAM, NVIDIA and AMD, one dashboard, OpenAI- and Anthropic-compatible API.

    GitHub · C++ · 3,094 stars · 430 forks · +69 stars in 24 hours · Trending score 3.63

  8. 8
    simplexai-labs/PolyStrata

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    GitHub · C++ · 1,280 stars · 166 forks · +60 stars in 24 hours · Trending score 3.63

  9. 9
    synchopate/llama-modchip

    Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).

    GitHub · Python · 1,387 stars · 134 forks · +38 stars in 24 hours · Trending score 3.55

  10. 10
    CapriChooms/CapriCore

    Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.

    GitHub · JavaScript · 259 stars · 29 forks · +74 stars in 24 hours · Trending score 3.53

  11. 11
    wici-ai/inferssd

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    GitHub · C++ · 1,262 stars · 113 forks · +32 stars in 24 hours · Trending score 3.48

  12. 12
    HKUDS/nanobot

    Your lightweight open-source personal agent.

    GitHub · Python · 50,224 stars · 8,758 forks · +57 stars in 24 hours · Trending score 3.45

  13. 13
    MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38

  14. 14
    JakeATX/llamAmpere

    llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

    GitHub · C++ · 403 stars · 50 forks · +87 stars in 24 hours · Trending score 3.35

  15. 15
    vstorm-co/agenticos

    Open-source, self-hosted AI agent platform for your company's AI teammates. Build, run and govern agents on your own servers and models: shared chat, RAG, skills, a real browser, 4,700+ MCP servers, budgets, approvals and an audit trail. An alternative to ChatGPT Enterprise and Grok Bot. Apache-2.0, built on Pydantic AI.

    GitHub · Python · 434 stars · 79 forks · +23 stars in 24 hours · Trending score 3.03

  16. 16
    Bai-Cute/big-blue-fish-desktop-pet

    蓝色大肥鱼 Windows AI 桌宠,内置 4B 本地大模型,以鲸鱼娘人设结合天气、科技新闻和当前应用,通过文字气泡温柔陪伴。支持一键安装与离电暂停推理。Big Blue Fish desktop pet with local LLM.

    GitHub · C# · 374 stars · 28 forks · +51 stars in 24 hours · Trending score 2.97

  17. 17
    RustingStudio/RustingStrata

    Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

    GitHub · Rust · 291 stars · 36 forks · +31 stars in 24 hours · Trending score 2.90

  18. 18
    tonhowtf/omniget

    A local MCP server that gives your coding agent a desktop toolbox: downloads from YouTube, torrents and every site yt-dlp supports, media conversion, files, chats and system cleanup. One line connects Claude Code, Codex, Cursor or Gemini CLI, and sensitive actions wait for your click. Free and open source for Windows, macOS and Linux.

    GitHub · Rust · 14,509 stars · 1,253 forks · +21 stars in 24 hours · Trending score 2.85

  19. 19
    LearningCircuit/local-deep-research

    ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

    GitHub · Python · 9,613 stars · 934 forks · +21 stars in 24 hours · Trending score 2.72

  20. 20
    peonist-ai/halogen-flash-server

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    GitHub · Shell · 1,403 stars · 101 forks · +17 stars in 24 hours · Trending score 2.66

  21. 21
    lemonadesaltbagel/airlock

    A privacy-first local coding agent that consults frontier AI models without exposing your source code.

    GitHub · TypeScript · 290 stars · 53 forks · +17 stars in 24 hours · Trending score 2.61

  22. 22
    nace-ai/kapitsa

    Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai

    GitHub · C++ · 833 stars · 115 forks · +14 stars in 24 hours · Trending score 2.56

  23. 23
    sangharshadhyeta/Strata-HotRod

    Run Qwen3.8-Flash-Next (125B) on an RTX 3060 12 GB with 30 GB of RAM, streaming experts from the SSD. 50-70 tok/s, 262K context. A fork of Strata.

    GitHub · C++ · 37 stars · 3 forks · +24 stars in 24 hours · Trending score 2.53

  24. 24
    AtomicBot-ai/Atomic-Chat

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

    GitHub · TypeScript · 2,034 stars · 234 forks · +21 stars in 24 hours · Trending score 2.50