PyRank

Fleets Python Packages

Python packages with the GitHub topic fleets. Sorted by monthly downloads, with stars and forks.
adwantg
kvfleet

KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets. Route requests using model quality, latency, cost, policy, and live GPU state.

189 0 0