GitHub · Python
vdev-ctrl/Adaptive-Learnable-Hierarchical-Routing-
This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.
- Stars
- 43
- Forks
- 4
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: attention-mechanism, deep-learning, efficient-inference, efficient-transformers, llm, long-context, pytorch, sparse-attention, sub-quadratic-attention, transformer
Latest data point: Nov 21, 2026 · 43 stars · 4 forks