PyRank

Ring Attention Python Packages

Python packages with the GitHub topic ring-attention. Sorted by relevance, with stars and monthly downloads.
feifeibear
yunchang

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

45K 678 80
DAMO-NLP-SG
inf-cl

A highly memory-efficient contrastive loss.

694 288 12