PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Llm Infra Python Packages

Python packages with the GitHub topic llm-infra. Sorted by monthly downloads, with stars and forks.
thu-ml
sageattention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

89K 4K 527
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology