Transformer Architecture Python Packages

zetascale

Build high-performance AI models with modular building blocks

gptmed

pip install gptmed

swin-transformer-pytorch

Implementation of the Swin Transformer in PyTorch.

sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

gpt3-torch

An implementation of the base GPT-3 Model architecture from the paper by OPENAI "Language Models are Few-Shot Learners"

transformer-builder

This package provides builder-like API to create really flexible transformers using PyTorch

joeynmt

Minimalist NMT for educational purposes

free-transformer

Free Transformer Architecture - an extension of the decoder Transformer that conditions its generative process on random latent variables which are learned without supervision

gpt4-torch

An implementation of the base GPT-3 Model architecture from the paper by OPENAI "Language Models are Few-Shot Learners"

ernie

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

z-transformers

z-transformers

bangla-ocr

Implementation of the paper 'Towards Full page Offline Bangla Handwritten Text Recognition using Image-to-Sequence Architecture'. For details, please read the README section.

padie-extended

An open-source Python package that uses AI to predict Nigerian languages, including English, Pidgin, Yoruba, Hausa, and Igbo.

triformer

Transformers components but in Triton

seq2seqsharp

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, MacOS), multimodal model for text and images and so on.

mmm-zeta

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

minimal-slt

Minimal Sign Language Translation package based on Hugging Face

aot-x

My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"

gptgpt

A lightweight GPT-based language model framework for training custom question-answering models on any domain