Zeta Python Packages

mambatransformer

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

teragpt

Train a production grade GPT in less than 400 lines of code. Better than Karpathy's verison and GIGAGPT

griffin-torch

Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"

hsss

Paper - Pytorch

mmm-zeta

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.