Rnns Python Packages

hsss

Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling"

mambatransformer

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

differential-transformer

An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.

simple-mamba

Implementation of a modular, high-performance, and simplistic mamba for high-speed applications

griffin-torch

Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"

token2index

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.