geometric-learning
Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
[𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models
