Cross Attention Python Packages

calm-pytorch

Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind

uform

Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

attention-map-diffusers

attention map tools for huggingface/diffusers

darkformer-pytorch

Unofficial Pytorch-based implementation of Google DeepMind's "Data-Aware Random Feature Kernels for Transformers" architecture. Featuring encoder-decoder models, language models, deterministic projections, and optional FlashAttention 2/3 support.

tgate

T-GATE: Temporally Gating Attention to Accelerate Diffusion Model for Free!