Attention Is All You Need Python Packages

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

yunchang

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

qwen

My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't released model code yet sooo...

sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

crabnet

Predict materials properties using only the composition information!

mambatransformer

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

longnet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

nonlinear-transformer

An Implementation of an Transformer model that generates tokens non-linearly all at once like the heptapods from Arrival

alr-transformer

Paper - Pytorch

tiny-gptv

Tiny GPTV - Pytorch

simple-transformer

A simple and modular implementation of the Transformer model in PyTorch

video-vit

Open source implementation of a vision transformer that can understand Videos using max vit as a foundation.

autort-swarms

Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"

mgqa

mgqa - Pytorch

audio-flamingo

Paper - Pytorch

cross-attn

MultiModalCrossAttn - Pytorch

screenai

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

kosmos2-torch

My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"

mobilevlm

Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices"

hlt-torch

Paper - Pytorch

liquidnet

Implementation of Liquid Nets in Pytorch

gats-torch

gats - Pytorch

mmqqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention

complex-attn

Implementation of the attention and transformer from "Building Blocks for a Complex-Valued Transformer Architecture"