PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Attention Is All You Need Python Packages

Python packages with the GitHub topic attention-is-all-you-need. Sorted by relevance, with stars and monthly downloads.
linto-ai
whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

96K 3K 211
feifeibear
yunchang

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

39K 667 78
kyegomez
qwen

My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't released model code yet sooo...

3K 13 3
awslabs
sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

3K 1K 320
sparks-baird
crabnet

Predict materials properties using only the composition information!

2K 17 7
kyegomez
mambatransformer

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

942 220 16
kyegomez
longnet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

934 720 61
kyegomez
nonlinear-transformer

An Implementation of an Transformer model that generates tokens non-linearly all at once like the heptapods from Arrival

899 10 0
kyegomez
alr-transformer

Paper - Pytorch

755 13 1
kyegomez
tiny-gptv

Tiny GPTV - Pytorch

543 16 0
nullHawk
simple-transformer

A simple and modular implementation of the Transformer model in PyTorch

406 4 0
kyegomez
video-vit

Open source implementation of a vision transformer that can understand Videos using max vit as a foundation.

389 12 0
kyegomez
autort-swarms

Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"

312 43 3
kyegomez
mgqa

mgqa - Pytorch

310 16 1
kyegomez
audio-flamingo

Paper - Pytorch

278 39 1
kyegomez
cross-attn

MultiModalCrossAttn - Pytorch

251 37 1
kyegomez
screenai

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

250 382 38
kyegomez
kosmos2-torch

My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"

231 74 6
kyegomez
mobilevlm

Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices"

228 15 0
kyegomez
hlt-torch

Paper - Pytorch

221 62 9
kyegomez
liquidnet

Implementation of Liquid Nets in Pytorch

219 71 11
kyegomez
gats-torch

gats - Pytorch

217 8 0
kyegomez
mmqqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention

176 5 0
kyegomez
complex-attn

Implementation of the attention and transformer from "Building Blocks for a Complex-Valued Transformer Architecture"

174 8 1
    • Data from PyPI, GitHub, ClickHouse, and BigQuery