PyRank

Text Generation Inference Python Packages

Python packages with the GitHub topic text-generation-inference. Sorted by relevance, with stars and monthly downloads.
huggingface
optimum-benchmark

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

12K 336 58