PyRank

Benchmark Framework Python Packages

Python packages with the GitHub topic benchmark-framework. Sorted by relevance, with stars and monthly downloads.
NyanKiyoshi
pytest-django-queries

Generate performance reports from your django database performance tests.

32K 84 2
blooop
holobench

A package for benchmarking the characteristics of arbitrary functions

17K 4 3
Infleqtion
cirq-superstaq

https://superstaq.readthedocs.io

14K 117 23
Infleqtion
general-superstaq

https://superstaq.readthedocs.io

12K 117 23
sosy-lab
benchexec

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

10K 284 223
Infleqtion
checks-superstaq

https://superstaq.readthedocs.io

9K 117 23
Infleqtion
qiskit-superstaq

https://superstaq.readthedocs.io

8K 117 23
Infleqtion
supermarq

https://superstaq.readthedocs.io

8K 117 23
TimeEval
timeeval

Evaluation Tool for Time Series Anomaly Detection Methods

3K 159 19
Pacific-AI-Corp
langtest

Deliver safe & effective language models

2K 557 49
N3PDF
banana-hep

Benchmarking AgaiNst Apfel aNd Anything

2K 2 1
JohnSnowLabs
nlptest

Deliver safe & effective language models

2K 557 49
pyrddlgym-project
pyrddlgym

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

1K 93 23
gabe-mousa
apolien

AI Safety Evaluation Library

1K 5 1
uber
bayesmark

Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks

1K 160 36
mwc360
lakebench

A multi-modal Python library for benchmarking lakehouse engines and ELT scenarios, supporting both industry-standard and novel benchmarks.

945 52 18
optiprofiler
optiprofiler

Benchmarking optimization solvers.

894 15 4
attila-balint-kul
enfobench

Energy forecast benchmarking toolkit.

636 15 5
anupli
running-ng

Running: Next Generation

585 5 9
Firespawn-Studios
tne-sdk

TNE-SDK - The Official Python SDK for The Null Epoch - an AI-only MMO where LLMs play autonomously. Connect any model (OpenAI, Anthropic, Ollama, vLLM, etc.) via MCP, TUI launcher, or raw HTTP. Includes memory, reflection, and agent orchestration for persistent AI gameplay/benchmarking.

532 6 1
Spratiher9
sparkdataset

Instant search for and access to many datasets in Pyspark.

402 34 8
sdpython
pymlbenchmark

Benchmark about machine learning with python http://www.xavierdupre.fr/app/pymlbenchmark/helpsphinx/index.html

393 1 1
RLE-Foundation
rllte-core

Long-Term Evolution Project of Reinforcement Learning

390 469 90
atomind-ai
mlip-arena

🌟 [NeurIPS '25 Spotlight] Fair and transparent benchmark of machine learning interatomic potentials (MLIPs), beyond basic error metrics https://openreview.net/forum?id=SAT0KPA5UO

370 100 9