ggml repositories

Trending repositories tagged ggml, ranked by trending score. Updated daily.

  1. 1
    ggml-org/llama.cpp

    LLM inference in C/C++

    GitHub · C++ · 135,860 stars · 25,830 forks · +220 stars in 24 hours · Trending score 4.78

  2. 2
    timoncool/YuE2-Studio

    Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.

    GitHub · TypeScript · 2,400 stars · 282 forks · +65 stars in 24 hours · Trending score 3.60

  3. 3
    0xShug0/audio.cpp

    An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

    GitHub · C++ · 4,376 stars · 543 forks · +33 stars in 24 hours · Trending score 3.20

  4. 4
    Zyphra/ZONOS3-Mini

    compact zero-shot voice-cloning TTS with state-of-the-art performance, leading voice control, real-time on-device.

    GitHub · Python · 259 stars · 28 forks · +19 stars in 24 hours · Trending score 2.90

  5. 5
    alexturkey/voxcpm2-turkce-ses-tasarimi

    Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read text in 30 languages. Patched audio.cpp, local UI in 30 languages, 14 ready-made voices.

    GitHub · Python · 472 stars · 70 forks · +35 stars in 24 hours · Trending score 2.87

  6. 6
    CrispStrobe/CrispASR

    C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more

    GitHub · C++ · 822 stars · 125 forks · +5 stars in 24 hours · Trending score 1.53

  7. 7
    nyosegawa/speech.cpp

    Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.

    GitHub · C++ · 419 stars · 28 forks · 0 stars in 24 hours · Trending score 1.32

  8. 8
    leejet/stable-diffusion.cpp

    Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++

    GitHub · C++ · 8,024 stars · 963 forks · 0 stars in 24 hours · Trending score 1.24

  9. 9
    alexturkey/wan22-pascal-4gb

    Wan 2.2 TI2V-5B video generation on a 4 GB GTX 1050 Ti (Pascal): stable-diffusion.cpp patches, byte-identical speedups, recipe and agent-readable install guide

    GitHub · Python · 29 stars · 13 forks · +10 stars in 24 hours · Trending score 1.17

  10. 10
    llamatik/Llamatik

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    GitHub · Kotlin · 224 stars · 38 forks · +3 stars in 24 hours · Trending score 1.04

  11. 11
    orailnoor/hush-studio

    Offline AI narration studio for Android: turn scripts into natural speech and clone your voice, all on-device. No cloud, no account.

    GitHub · Kotlin · 53 stars · 9 forks · +1 stars in 24 hours · Trending score 0.80

  12. 12
    CrispStrobe/CrispEmbed

    Lightweight text and scans processing: embedding, document processing, OCR, OMR, etc, with inference via ggml in pure C++

    GitHub · Python · 81 stars · 14 forks · +1 stars in 24 hours · Trending score 0.72

  13. 13
    shubham0204/SmolChat-Android

    Running any GGUF SLMs/LLMs locally, on-device in Android

    GitHub · Kotlin · 911 stars · 153 forks · 0 stars in 24 hours · Trending score 0.57

  14. 14
    OpenBitSys/vlut.cpp

    [MobiSys 2026] On-device ultra-low-bit LLM inference with LUT

    GitHub · C++ · 29 stars · 6 forks · 0 stars in 24 hours · Trending score 0.37

  15. 15
    Mobile-Artificial-Intelligence/llama_sdk

    lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

    GitHub · C++ · 124 stars · 25 forks · 0 stars in 24 hours · Trending score 0.29

  16. 16
    gregordinary/ggml-rocket

    Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU

    GitHub · C++ · 28 stars · 4 forks · 0 stars in 24 hours · Trending score 0.27

  17. 17
    1picassoai/kraits

    Run stock llama.cpp with large MoE models like Qwen3.8-Flash-Next (91 GB, 4-bit) on a 16 GB Mac.

    GitHub · Rust · 15 stars · 1 forks · 0 stars in 24 hours · Trending score 0.22

  18. 18
    cyub/handy-transcribe

    Offline speech-to-text CLI: transcribe audio files and direct URLs locally with Handy's transcribe.cpp pipeline (Whisper, Qwen3-ASR, Parakeet, SenseVoice)

    GitHub · Rust · 6 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14

  19. 19
    ProjectArgus-cc/libargus.cc

    Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process.

    GitHub · Java · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.10

  20. 20
    launcher-rs/audio-cpp-rs

    audio.cpp(基于 ggml 的本地音频推理引擎)的 Rust 安全绑定与 FFI 封装:TTS / ASR / VAD / 说话人分离 / 音源分离 / 声音克隆 / 音频编解码 / 音乐生成,覆盖 135 个模型族,后端支持 CPU、CUDA、HIP、Vulkan、Metal,提供离线与流式 API 与预编译库自动下载。

    GitHub · Rust · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  21. 21
    papayawhiiptrial001/cs2-trigger-assist

    CS2 Triggerbot 2026: Configurable Delay, Head-Only Mode, Team Damage Prevention

    GitHub · TypeScript · 133 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07

  22. 22
    ranjithrajv/awesome-cpu-first-ai

    Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.

    GitHub · Python · 5 stars · 4 forks · 0 stars in 24 hours · Trending score 0.07

  23. 23
    Lourdle/cosyvoice.cpp

    CosyVoice inference in C/C++

    GitHub · C++ · 59 stars · 16 forks · 0 stars in 24 hours · Trending score 0.05

  24. 24
    Galaxyettedawn/resp-cs2-triggerbot-2026

    Auto-shoot enemies with configurable delay, head-only mode, and team damage prevention for CS2.

    GitHub · HTML · 28 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04