Flexible residual connections for PyTorch with a clean API. Build complex skip connections using Record/Apply modules. 5 operations (add, concat, gated, highway, multiply), learnable alphas, automatic projection. Thread-safe for DataParallel/DDP. Fully typed and tested.
212
1
0
