PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Gpu Serving Python Packages

Python packages with the GitHub topic gpu-serving. Sorted by monthly downloads, with stars and forks.
coconut-labs
kvwarden

Tenant-fair LLM inference orchestration on a single GPU. No Kubernetes.

206 2 1
coconut-labs
infergrid

Tenant-fair LLM inference orchestration on a single GPU. No Kubernetes.

141 2 1
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology