Linear Attention Python Packages

sketchssm

SketchSSM: Write to the Full State, Read from a Compact Sketch

taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention

bdh-cq

Implementation of BDH-CQ: In-Context Learning with Recurrent Latent Reasoning, proposed by Pathway Research

agent-attention-pytorch

Implementation of Agent Attention in Pytorch

darkformer-pytorch

Unofficial Pytorch-based implementation of Google DeepMind's "Data-Aware Random Feature Kernels for Transformers" architecture. Featuring encoder-decoder models, language models, deterministic projections, and optional FlashAttention 2/3 support.

leap-transformer

LEAP: Linear Explainable Attention in Parallel for causal language modeling with O(1) path length, and O(1) inference

mlx-recurrence

Fused Metal training kernels for linear recurrence on Apple Silicon — SSD (Mamba-2), GLA, RG-LRU, rotational LRU. Flash-linear-attention for MLX: 12-18x less training memory, production-validated.