PyRank

Tokens Per Second Python Packages

Python packages with the GitHub topic tokens-per-second. Sorted by monthly downloads, with stars and forks.
RudrenduPaul
inferbench-cli

Benchmark local LLM inference engines (llama.cpp, omlx) on your own hardware with real tokens/sec, not borrowed numbers

609 0 0