PyRank

Production Inference Python Packages

Python packages with the GitHub topic production-inference. Sorted by relevance, with stars and monthly downloads.
Mattral
flashspec

Adaptive speculative-decoding inference engine with Triton-optimised verification and online bandit draft selection.

2K 11 0