performer
Unofficial Pytorch-based implementation of Google DeepMind's "Data-Aware Random Feature Kernels for Transformers" architecture. Featuring encoder-decoder models, language models, deterministic projections, and optional FlashAttention 2/3 support.
Vision Xformers
