cuda repositories

Trending repositories tagged cuda, ranked by trending score. Updated daily.

  1. 1
    debpalash/VoiceStudio

    VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

    GitHub · Python · 114,885 stars · 12,776 forks · +1,472 stars in 24 hours · Trending score 6.04

  2. 2
    bendlang/bend

    Bend 2: a fast language that blocks AI mistakes via proof. Install: curl -fsSL https://bend-lang.com/install.sh | sh

    GitHub · TypeScript · 25,474 stars · 812 forks · +423 stars in 24 hours · Trending score 4.43

  3. 3
    vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    GitHub · Python · 97,255 stars · 25,073 forks · +109 stars in 24 hours · Trending score 4.26

  4. 4
    jamiepine/voicebox

    The open-source AI voice studio. Clone, dictate, create.

    GitHub · Python · 60,970 stars · 7,684 forks · +128 stars in 24 hours · Trending score 4.09

  5. 5
    hashcat/hashcat

    World's fastest and most advanced password recovery utility

    GitHub · C · 27,387 stars · 3,638 forks · +169 stars in 24 hours · Trending score 3.96

  6. 6
    datawhalechina/zero-to-sglang

    Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

    GitHub · Python · 2,295 stars · 188 forks · +103 stars in 24 hours · Trending score 3.69

  7. 7
    mw00/project-maya

    Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash (220B) on your own GPUs - from 8 GB of VRAM, NVIDIA and AMD, one dashboard, OpenAI- and Anthropic-compatible API.

    GitHub · C++ · 3,094 stars · 430 forks · +69 stars in 24 hours · Trending score 3.63

  8. 8
    simplexai-labs/PolyStrata

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    GitHub · C++ · 1,280 stars · 166 forks · +60 stars in 24 hours · Trending score 3.63

  9. 9
    timoncool/YuE2-Studio

    Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.

    GitHub · TypeScript · 2,387 stars · 280 forks · +58 stars in 24 hours · Trending score 3.57

  10. 10
    wici-ai/inferssd

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    GitHub · C++ · 1,262 stars · 113 forks · +32 stars in 24 hours · Trending score 3.48

  11. 11
    JakeATX/llamAmpere

    llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

    GitHub · C++ · 403 stars · 50 forks · +87 stars in 24 hours · Trending score 3.35

  12. 12
    NVIDIA/skills

    Agent Skills for NVIDIA products — install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.

    GitHub · Python · 4,092 stars · 547 forks · +37 stars in 24 hours · Trending score 3.24

  13. 13
    Avril-Exoplanet/Avril

    AI-guided, evidence-preserving exoplanet candidate discovery for public TESS data.

    GitHub · Python · 423 stars · 0 forks · +95 stars in 24 hours · Trending score 3.23

  14. 14
    harry7557558/spirula-studio

    Cross-vendor 3D Gaussian Splatting trainer - video to splat to mesh, Vulkan or CUDA.

    GitHub · C++ · 2,530 stars · 244 forks · +37 stars in 24 hours · Trending score 3.21

  15. 15
    Veloresearch/kinetic

    The open engine for running AI on your own computer. Fast, exact, open source.

    GitHub · Rust · 202 stars · 20 forks · +62 stars in 24 hours · Trending score 3.17

  16. 16
    NVIDIA/cutlass

    CUDA Templates and Python DSLs for High-Performance Linear Algebra

    GitHub · C++ · 10,747 stars · 2,190 forks · +49 stars in 24 hours · Trending score 3.06

  17. 17
    Aseiel/VideoHighlighter

    Open-source local AI video analyzer powered by Ollama. Visual search, automatic highlights, scene/action/object detection, audio analysis, and subtitle generation. Free, offline alternative to Twelve Labs, Runway, and Descript.

    GitHub · Python · 442 stars · 57 forks · +45 stars in 24 hours · Trending score 3.02

  18. 18
    RustingStudio/RustingStrata

    Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

    GitHub · Rust · 291 stars · 36 forks · +31 stars in 24 hours · Trending score 2.90

  19. 19
    sgl-project/sglang-omni

    High Performance Serving Runtime For Interactive Super Intelligence System

    GitHub · Python · 1,827 stars · 762 forks · +15 stars in 24 hours · Trending score 2.83

  20. 20
    flashinfer-ai/flashinfer

    FlashInfer: Kernel Library for LLM Serving

    GitHub · Cuda · 6,961 stars · 1,773 forks · +21 stars in 24 hours · Trending score 2.81

  21. 21
    alexturkey/voxcpm2-turkce-ses-tasarimi

    Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read text in 30 languages. Patched audio.cpp, local UI in 30 languages, 14 ready-made voices.

    GitHub · Python · 467 stars · 70 forks · +25 stars in 24 hours · Trending score 2.69

  22. 22
    NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    GitHub · Python · 15,105 stars · 2,944 forks · +21 stars in 24 hours · Trending score 2.65

  23. 23
    LMCache/LMCache

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    GitHub · Python · 12,398 stars · 2,174 forks · +18 stars in 24 hours · Trending score 2.63

  24. 24
    DevDock-AI/Speedy

    Qwen3.8-Flash-Next (125B MoE) up to 1M context on one or two RTX cards (tuned on 3080 10gb). A measured, tuned and benchmarked fork of Strata.

    GitHub · C++ · 125 stars · 8 forks · +26 stars in 24 hours · Trending score 2.59