Residuals Python Packages

hyper-connections

Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public

deep-cross-attention

Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch

attn-res

Single-file PyTorch implementation of Attention Residuals (Kimi Team, 2026) with GQA, SwiGLU, and RoPE.

openfoam-residuals

Python script to plot residual data in OpenFOAM case folders.