Sequence Modeling Python Packages

fla-core

🚀 Efficient implementations for emerging model architectures

flash-linear-attention

🚀 Efficient implementations for emerging model architectures

gateloop-transformer

Implementation of GateLoop Transformer in Pytorch and Jax

rwkv-fla

Fast Triton-based implementations for RWKV

decepticons

A backend-neutral kernel of predictive primitives for descendant systems. O(n) attention is deception.

arabicnlp

Python package for arabic NLP

s5-pytorch

Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)

pyxlstm

PyxLSTM: An efficient and extensible implementation of the xLSTM architecture

discretax

Discretax is a light weight collection of state space models implemented in JAX ⚡️

transact-tf

An implementation of TransAct: Transformer-based Realtime User Action Model for Recommendation

linax

Discretax is a light weight collection of state space models implemented in JAX ⚡️

spectrans

Modular spectral transformer implementations in PyTorch with Fourier, wavelet, and other frequency-domain operations for efficient sequence modeling.

lrnnx

A unified PyTorch library for Linear RNNs