non-transformer
Non-Transformer language model with a self-organizing memory pool and live introspective signals. Code, checkpoints and controls, 30M–125M.
Backend-neutral kernel of predictive primitives. O(n) attention is deception.