linformer
My take on a practical implementation of Linformer for Pytorch.
Vision Xformers
Lumenspark is a lightweight Linformer-based Language Model Trained from Scratch