PyRank

Llm Capacity Python Packages

Python packages with the GitHub topic llm-capacity. Sorted by relevance, with stars and monthly downloads.
gojiplus
slosizer

Capacity planning for reserved LLM throughput: latency, headroom, and synthetic workload simulation.

120 1 0