cross-attention
Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
🚀 Cross attention map tools for huggingface/diffusers
T-GATE: Temporally Gating Attention to Accelerate Diffusion Model for Free!