Attention Is All You Need Python Packages

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

yunchang

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

qwen

My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't released model code yet sooo...

crabnet

Predict materials properties using only the composition information!

sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

mambatransformer

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

nonlinear-transformer

An Implementation of an Transformer model that generates tokens non-linearly all at once like the heptapods from Arrival

longnet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

alr-transformer

Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"

tiny-gptv

Tiny GPTV - Pytorch

simple-transformer

Implementation of Transformer model in PyTorch

video-vit

Open source implementation of a vision transformer that can understand Videos using max vit as a foundation.

mgqa

mgqa - Pytorch

audio-flamingo

Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities"

autort-swarms

Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"

liquidnet

Implementation of Liquid Nets in Pytorch

gats-torch

Implementation of GATS from the paper: "GATS: Gather-Attend-Scatter" in pytorch and zeta

mobilevlm

Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices"

kosmos2-torch

My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"

hlt-torch

Implementation of the transformer from the paper: "Real-World Humanoid Locomotion with Reinforcement Learning"

screenai

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

cross-attn

MultiModalCrossAttn - Pytorch

mmqqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention

complex-attn

Implementation of the attention and transformer from "Building Blocks for a Complex-Valued Transformer Architecture"