Cuda repositories

Trending Cuda repositories on GitHub and GitLab, ranked by trending score. Updated daily.

  1. 1
    flashinfer-ai/flashinfer

    FlashInfer: Kernel Library for LLM Serving

    GitHub · Cuda · 6,961 stars · 1,773 forks · +21 stars in 24 hours · Trending score 2.81

  2. 2
    bpx03/QEngine

    Fast open-source (MIT) LLM inference engine in C++/CUDA for RTX 3090-class GPUs: Qwen3.8-Flash-Next (~1,000 tok/s with 8 agents on 3x RTX 3090) and Qwen3.8-27B, OpenAI/Anthropic-compatible API.

    GitHub · Cuda · 75 stars · 8 forks · +4 stars in 24 hours · Trending score 1.75

  3. 3
    NVIDIA/cuopt

    GPU accelerated decision optimization

    GitHub · Cuda · 1,120 stars · 262 forks · +3 stars in 24 hours · Trending score 1.50

  4. 4
    NVIDIA/cudnn-frontend

    cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

    GitHub · Cuda · 1,007 stars · 340 forks · +3 stars in 24 hours · Trending score 1.47

  5. 5
    NVIDIA/cuvs

    cuVS - a library for vector search and clustering on the GPU

    GitHub · Cuda · 901 stars · 266 forks · +2 stars in 24 hours · Trending score 1.22

  6. 6
    brucefan1983/GPUMD

    Graphics Processing Units Molecular Dynamics

    GitHub · Cuda · 868 stars · 221 forks · +2 stars in 24 hours · Trending score 1.17

  7. 7
    NVIDIA/raft

    RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

    GitHub · Cuda · 1,055 stars · 260 forks · +2 stars in 24 hours · Trending score 1.10

  8. 8
    Picom-code/pico-dgx-ds4

    DeepSeek V4.1 Flash on 4x DGX Spark: 90/144 tok/s chat/code single-user, 376 tok/s at 16 distinct users, 1M context, images. Fork of blaesus/dsgx10.

    GitHub · Cuda · 121 stars · 23 forks · 0 stars in 24 hours · Trending score 1.07

  9. 9
    NVIDIA/nvbench

    CUDA Kernel Benchmarking Library

    GitHub · Cuda · 949 stars · 137 forks · 0 stars in 24 hours · Trending score 0.95

  10. 10
    mirage-project/mirage

    Mirage Persistent Kernel: Compiling LLMs into a MegaKernel

    GitHub · Cuda · 2,609 stars · 274 forks · 0 stars in 24 hours · Trending score 0.94

  11. 11
    kindlingai/gr8

    A from-scratch CUDA inference engine for 1-6 DGX Sparks (GB10): GLM-5.3, GLM-5.3-Flash and DeepSeek-V4.1-Flash

    GitHub · Cuda · 83 stars · 16 forks · 0 stars in 24 hours · Trending score 0.70

  12. 12
    joris-sta/llama-cpp-pascal

    Pre-tensor-core (Pascal GTX 1070) inference optimizations for llama.cpp: native Turbo3 compressed-KV flash attention, PTQ1 ternary DP4A matmuls, chunked gated-delta-net, TurboQuant/VBR KV on 80K-262K contexts

    GitHub · Cuda · 22 stars · 2 forks · 0 stars in 24 hours · Trending score 0.60

  13. 13
    NVIDIA/cuCollections

    GitHub · Cuda · 678 stars · 126 forks · 0 stars in 24 hours · Trending score 0.57

  14. 14
    NVIDIA-BioNeMo/nvMolKit

    A high-performance, GPU-accelerated library for key computational chemistry tasks, such as molecular similarity, conformer generation, and geometry relaxation.

    GitHub · Cuda · 284 stars · 31 forks · 0 stars in 24 hours · Trending score 0.55

  15. 15
    Better-Call-Paul/blackwell_gemm

    GitHub · Cuda · 20 stars · 3 forks · 0 stars in 24 hours · Trending score 0.48

  16. 16
    A2R-Lab/GATO

    GPU-Accelerated Trajectory Optimization

    GitHub · Cuda · 53 stars · 4 forks · 0 stars in 24 hours · Trending score 0.47

  17. 17
    dtc2025ag/MOAI_GPU

    GPU version

    GitHub · Cuda · 16 stars · 2 forks · +1 stars in 24 hours · Trending score 0.46

  18. 18
    perplexityai/cake-pplx-collab

    GitHub · Cuda · 6 stars · 2 forks · +1 stars in 24 hours · Trending score 0.42

  19. 19
    Bobliuuu/open-flapping-airplanes

    reproducing the flapping airplanes megakernel, in collab with magni

    GitHub · Cuda · 141 stars · 18 forks · 0 stars in 24 hours · Trending score 0.37

  20. 20
    tsinghua-ideal/flash-topk-attention

    Efficient and unified implementations for TopK-based sparse attention

    GitHub · Cuda · 41 stars · 1 forks · 0 stars in 24 hours · Trending score 0.36

  21. 21
    leDissolution/gewell

    Gemma 4 inference engine

    GitHub · Cuda · 9 stars · 2 forks · 0 stars in 24 hours · Trending score 0.32

  22. 22
    Nekofish-L/mxfp6_sm120

    High-performance MXFP6 GEMM implementation optimized for NVIDIA SM120 GPUs.

    GitHub · Cuda · 15 stars · 2 forks · 0 stars in 24 hours · Trending score 0.31

  23. 23
    nerficg-project/efficient-gaussian-appearance

    Faster-GS with JIT-compiled view-dependent appearance models and a WebGL viewer, described in the paper "Compact Neural Appearance Models for Efficient Gaussian Splatting"

    GitHub · Cuda · 42 stars · 3 forks · 0 stars in 24 hours · Trending score 0.24

  24. 24
    saltsystemslab/gallatin

    Gallatin is a general-purpose memory manager for CUDA that allows for threads to quickly malloc and free memory of arbitrary size inside of kernels.

    GitHub · Cuda · 29 stars · 3 forks · 0 stars in 24 hours · Trending score 0.22