Attention Python Packages

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

flashinfer-python

FlashInfer: Kernel Library for LLM Serving

nvidia-cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

flashinfer-cubin

FlashInfer: Kernel Library for LLM Serving

sglang-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

sgl-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

sageattention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

dreamer4

Implementation of Danijar's latest iteration for his Dreamer line of work

performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

keras-cv-attention-models

Keras beit,caformer,CMT,CoAtNet,convnext,davit,dino,efficientdet,edgenext,efficientformer,efficientnet,eva,fasternet,fastervit,fastvit,flexivit,gcvit,ghostnet,gpvit,hornet,hiera,iformer,inceptionnext,lcnet,levit,maxvit,mobilevit,moganet,nat,nfnets,pvt,swin,tinynet,tinyvit,uniformer,volo,vanillanet,yolor,yolov7,yolov8,yolox,gpt2,llama2, alias kecam

keras-transformer

Transformer implemented in Keras

activations

AReLU: Attention-based-Rectified-Linear-Unit

keras-position-wise-feed-forward

Feed forward layer implemented in Keras

native-sparse-attention-pytorch

Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper

transfusion-pytorch

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

optimumai

Unlock the math behind AI — run any operation with explain=True for a step-by-step trace, terminal visualization, and the intuition of why AI uses it.

rotary-spatial-embeddings

PyTorch implementation of Rotary Spatial Embeddings

sglang-kt

SGLang is a high-performance serving framework for large language models and multimodal models.

qwen

My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't released model code yet sooo...

nexusquant-kv

Training-free KV cache compression via E8 lattice quantization; fits longer context in the same VRAM

labml-nn

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

nmn

Not the neurons we want, but the neurons we need

h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

rl4co

A PyTorch library for all things Reinforcement Learning (RL) for Combinatorial Optimization (CO)