PyRank

Llm Cascade Python Packages

Python packages with the GitHub topic llm-cascade. Sorted by monthly downloads, with stars and forks.
ymoslem
cre-router

Cascaded Framework for Cost-Aware LLM Serving

2K 3 0
varunkotte6
ucci-router

UCCI: calibrated cascade routing for LLMs. Reference implementation of arXiv:2605.18796 (Python, CLI, Rust).

703 2 0