attention repositories
Trending repositories tagged attention, ranked by trending score. Updated daily.
-
1
flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
GitHub · Cuda · 6,961 stars · 1,773 forks · +21 stars in 24 hours · Trending score 2.81
-
2
zhuangzhaoyeye/llm_course
写给算法工程师的大模型课程:34 课,每课从一个问题出发,用具体数字把机制从头算一遍
GitHub · HTML · 68 stars · 13 forks · +20 stars in 24 hours · Trending score 2.26
-
3
aa1143/NamiGPT
零基础入门大模型(LLM)的基础教程:从零手写 GPT-2,一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step
GitHub · Python · 258 stars · 25 forks · +14 stars in 24 hours · Trending score 2.06
-
4
labmlai/annotated_deep_learning_paper_implementations
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
GitHub · Python · 67,773 stars · 6,792 forks · +8 stars in 24 hours · Trending score 1.81
-
5
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
GitHub · Python · 38,872 stars · 10,647 forks · −123 stars in 24 hours · Trending score 1.80
-
6
NVIDIA/cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
GitHub · Cuda · 1,007 stars · 340 forks · +3 stars in 24 hours · Trending score 1.47
-
7
kyegomez/awesome-multi-agent-papers
A compilation of the best multi-agent papers
GitHub · TeX · 1,718 stars · 174 forks · +5 stars in 24 hours · Trending score 1.26
-
8
kyegomez/OpenMythos
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
GitHub · Python · 14,932 stars · 3,264 forks · +4 stars in 24 hours · Trending score 1.20
-
9
walkinglabs/modern-llm-notebook
A hands-on course on modern LLM architectures, training, and inference, with step-by-step PyTorch implementations and runnable notebooks.
GitHub · Jupyter Notebook · 289 stars · 62 forks · +2 stars in 24 hours · Trending score 0.95
-
10
OrbitInfra/OrbitKV
OrbitKV is a High Performance KV Cache System for LLM Inference.
GitHub · Rust · 284 stars · 19 forks · +1 stars in 24 hours · Trending score 0.82
-
11
llmsresearch/llm-flashcards
211 free visual cards about large language models, from tokenization to deployment. Full collection: 376 cards.
GitHub · MDX · 145 stars · 16 forks · −1 stars in 24 hours · Trending score 0.74
-
12
chessformer-lens/chessformer_lens
A toolkit+visualizer that is designed for mech interp researchers working with chess models that use transformers tokenized by square.
GitHub · Python · 10 stars · 0 forks · +1 stars in 24 hours · Trending score 0.55
-
13
flagos-ai/FlagAttention
A collection of memory efficient attention operators implemented in the Triton language.
GitHub · Python · 327 stars · 47 forks · 0 stars in 24 hours · Trending score 0.27
-
14
AhmadJeddi/LLM-VLM-Guide
A beginner-first guide to how language and multimodal models work — from language models and Transformers to LLMs, VLMs, audio, video, and modern model families.
GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22
-
15
BreCaspian/Deep_Learning_Foundation_and_Concepts-Springer
🌟The complete open-source release of the book 《 Deep Learning: Foundations and Concepts 》 and its related supporting resources
GitHub · Jupyter Notebook · 125 stars · 20 forks · 0 stars in 24 hours · Trending score 0.14
-
16
Codesammit/Valorant-Aim-Architecture-Overlay
Valorant 2026: AI-Powered Crosshair & Cloud DNS Overlay for Next-Gen Esports
GitHub · HTML · 54 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
17
mojolearn/mojolearn
GPU machine learning in Mojo that supports bitwise identical inference and training on Apple Metal, NVIDIA CUDA and AMD HIP.
GitHub · Mojo · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
18
google-research/scenic
Scenic: A Jax Library for Computer Vision Research and Beyond
GitHub · Python · 3,848 stars · 483 forks · −1 stars in 24 hours · Trending score 0.10
-
19
mlsamurai/transformers-from-scratch
A free course in ten notebooks: an English–Russian translator written in PyTorch from the tokenizer up, trained on a free GPU, evaluated and shipped as a Docker image
GitHub · Jupyter Notebook · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
20
LaoBro/ComfyUI-GPU-Tuning
Measured runtime tuning for ComfyUI: per-architecture kernel selection, int8 linear tiles, butterfly convrot rotation, attention kernels (gfx906 first-class)
GitHub · Python · 10 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07
-
21
acquiredintelligence/attend
Real-time reactions for agents. Decide when a live event should wake your agent: settle the stream, judge it, route it (interrupt, queue, note, ask, skip, wait).
GitHub · TypeScript · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
22
MuLabPKU/TransArch
Design hardware-friendly model architectures and migrate existing LLMs with minimal performance loss
GitHub · Python · 518 stars · 35 forks · 0 stars in 24 hours · Trending score 0.04
-
23
jacoxu/encoder_decoder
Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq
GitHub · Python · 279 stars · 122 forks · 0 stars in 24 hours · Trending score 0.00
-
24
tuzhaopeng/NMT
Attention-based NMT with Coverage, Context Gate, and Reconstruction
GitHub · Python · 95 stars · 27 forks · 0 stars in 24 hours · Trending score 0.00