PyRank

Fleets Python Packages

Python packages with the GitHub topic fleets. Sorted by relevance, with stars and monthly downloads.
adwantg
kvfleet

KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets. Route requests using model quality, latency, cost, policy, and live GPU state.

319 0 0