PyRank

Production Inference Python Packages

Python packages with the GitHub topic production-inference. Sorted by monthly downloads, with stars and forks.
Mattral
flashspec

Adaptive speculative-decoding inference engine with Triton-optimised verification and online bandit draft selection.

201 16 0