PyRank

Deepspeed Ulysses Python Packages

Python packages with the GitHub topic deepspeed-ulysses. Sorted by monthly downloads, with stars and forks.
feifeibear
yunchang

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

161K 695 87