delta-rule
Non-Transformer language model with a self-organizing memory pool and live introspective signals. Code, checkpoints and controls, 30M–125M.
