flash-attention-2
Cross-platform FlashAttention-2 Triton implementation for Turing+ GPUs with custom configuration mode
Flash Attention Implementation with Multiple Backend Support and Sharding This module provides a flexible implementation of Flash Attention with support for different backends (GPU, TPU, CPU) and platforms (Triton, Pallas, JAX).