Sequence Modeling Python Packages

fla-core

🚀 Efficient implementations for emerging model architectures

flash-linear-attention

🚀 Efficient implementations for emerging model architectures

gateloop-transformer

Implementation of GateLoop Transformer in Pytorch and Jax

rwkv-fla

🚀 Efficient implementations for emerging model architectures

s5-pytorch

Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)

arabicnlp

Python package for Arabic natural language processing

decepticons

Backend-neutral kernel of predictive primitives. O(n) attention is deception.

discretax

Discretax is a light weight collection of state space models implemented in JAX ⚡️

pyxlstm

PyxLSTM: An efficient and extensible implementation of the xLSTM architecture

linax

State Space Models in Jax

transact-tf

An unofficial implementation of "TransAct: Transformer-based Realtime User Action Model for Recommendation at Pinterest" in Tensorflow

spectrans

Modular spectral transformer implementations in PyTorch with Fourier, wavelet, and other frequency-domain operations for efficient sequence modeling.

lrnnx

A unified PyTorch library for Linear RNNs