PyRank

Sparse Attention Python Packages

Python packages with the GitHub topic sparse-attention. Sorted by relevance, with stars and monthly downloads.
SHI-Labs
natten

Fast Multi-dimensional Sparse Attention

14K 750 61
lucidrains
native-sparse-attention-pytorch

Native Sparse Attention

3K 805 52
dliptak001
hypercube-hopfield

Modern Hopfield associative memory on a hypercube graph. Sparse local-attention retrieval with exponential capacity. C++23 and Python SDKs.

1K 1 0
HKUSTDial
flash-sparse-attn

Trainable fast and memory-efficient sparse attention

595 681 56
SmallDoges
flash-dmattn

Trainable fast and memory-efficient sparse attention

138 690 56
bytedance
shadowkv

shadow kv cache

78 297 23