attention repositories

Trending repositories tagged attention, ranked by trending score. Updated daily.

  1. 1
    flashinfer-ai/flashinfer

    FlashInfer: Kernel Library for LLM Serving

    GitHub · Cuda · 6,961 stars · 1,773 forks · +21 stars in 24 hours · Trending score 2.81

  2. 2
    zhuangzhaoyeye/llm_course

    写给算法工程师的大模型课程:34 课,每课从一个问题出发,用具体数字把机制从头算一遍

    GitHub · HTML · 68 stars · 13 forks · +20 stars in 24 hours · Trending score 2.26

  3. 3
    aa1143/NamiGPT

    零基础入门大模型(LLM)的基础教程:从零手写 GPT-2,一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step

    GitHub · Python · 258 stars · 25 forks · +14 stars in 24 hours · Trending score 2.06

  4. 4
    labmlai/annotated_deep_learning_paper_implementations

    🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

    GitHub · Python · 67,773 stars · 6,792 forks · +8 stars in 24 hours · Trending score 1.81

  5. 5
    sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    GitHub · Python · 38,872 stars · 10,647 forks · −123 stars in 24 hours · Trending score 1.80

  6. 6
    NVIDIA/cudnn-frontend

    cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

    GitHub · Cuda · 1,007 stars · 340 forks · +3 stars in 24 hours · Trending score 1.47

  7. 7
    kyegomez/awesome-multi-agent-papers

    A compilation of the best multi-agent papers

    GitHub · TeX · 1,718 stars · 174 forks · +5 stars in 24 hours · Trending score 1.26

  8. 8
    kyegomez/OpenMythos

    A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.

    GitHub · Python · 14,932 stars · 3,264 forks · +4 stars in 24 hours · Trending score 1.20

  9. 9
    walkinglabs/modern-llm-notebook

    A hands-on course on modern LLM architectures, training, and inference, with step-by-step PyTorch implementations and runnable notebooks.

    GitHub · Jupyter Notebook · 289 stars · 62 forks · +2 stars in 24 hours · Trending score 0.95

  10. 10
    OrbitInfra/OrbitKV

    OrbitKV is a High Performance KV Cache System for LLM Inference.

    GitHub · Rust · 284 stars · 19 forks · +1 stars in 24 hours · Trending score 0.82

  11. 11
    llmsresearch/llm-flashcards

    211 free visual cards about large language models, from tokenization to deployment. Full collection: 376 cards.

    GitHub · MDX · 145 stars · 16 forks · −1 stars in 24 hours · Trending score 0.74

  12. 12
    chessformer-lens/chessformer_lens

    A toolkit+visualizer that is designed for mech interp researchers working with chess models that use transformers tokenized by square.

    GitHub · Python · 10 stars · 0 forks · +1 stars in 24 hours · Trending score 0.55

  13. 13
    flagos-ai/FlagAttention

    A collection of memory efficient attention operators implemented in the Triton language.

    GitHub · Python · 327 stars · 47 forks · 0 stars in 24 hours · Trending score 0.27

  14. 14
    AhmadJeddi/LLM-VLM-Guide

    A beginner-first guide to how language and multimodal models work — from language models and Transformers to LLMs, VLMs, audio, video, and modern model families.

    GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22

  15. 15
    BreCaspian/Deep_Learning_Foundation_and_Concepts-Springer

    🌟The complete open-source release of the book 《 Deep Learning: Foundations and Concepts 》 and its related supporting resources

    GitHub · Jupyter Notebook · 125 stars · 20 forks · 0 stars in 24 hours · Trending score 0.14

  16. 16
    Codesammit/Valorant-Aim-Architecture-Overlay

    Valorant 2026: AI-Powered Crosshair & Cloud DNS Overlay for Next-Gen Esports

    GitHub · HTML · 54 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  17. 17
    mojolearn/mojolearn

    GPU machine learning in Mojo that supports bitwise identical inference and training on Apple Metal, NVIDIA CUDA and AMD HIP.

    GitHub · Mojo · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  18. 18
    google-research/scenic

    Scenic: A Jax Library for Computer Vision Research and Beyond

    GitHub · Python · 3,848 stars · 483 forks · −1 stars in 24 hours · Trending score 0.10

  19. 19
    mlsamurai/transformers-from-scratch

    A free course in ten notebooks: an English–Russian translator written in PyTorch from the tokenizer up, trained on a free GPU, evaluated and shipped as a Docker image

    GitHub · Jupyter Notebook · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  20. 20
    LaoBro/ComfyUI-GPU-Tuning

    Measured runtime tuning for ComfyUI: per-architecture kernel selection, int8 linear tiles, butterfly convrot rotation, attention kernels (gfx906 first-class)

    GitHub · Python · 10 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07

  21. 21
    acquiredintelligence/attend

    Real-time reactions for agents. Decide when a live event should wake your agent: settle the stream, judge it, route it (interrupt, queue, note, ask, skip, wait).

    GitHub · TypeScript · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  22. 22
    MuLabPKU/TransArch

    Design hardware-friendly model architectures and migrate existing LLMs with minimal performance loss

    GitHub · Python · 518 stars · 35 forks · 0 stars in 24 hours · Trending score 0.04

  23. 23
    jacoxu/encoder_decoder

    Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq

    GitHub · Python · 279 stars · 122 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    tuzhaopeng/NMT

    Attention-based NMT with Coverage, Context Gate, and Reconstruction

    GitHub · Python · 95 stars · 27 forks · 0 stars in 24 hours · Trending score 0.00