PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Benchmarking Python Packages

Python packages with the GitHub topic benchmarking. Sorted by relevance, with stars and monthly downloads.
ionelmc
pytest-benchmark

pytest fixture for benchmarking code

14.2M 1K 132
locustio
locust

Write scalable load tests in plain Python 🚗💨

13.5M 28K 3K
CodSpeedHQ
pytest-codspeed

A pytest plugin to create benchmarks

3.9M 125 19
psf
pyperf

Toolkit to run Python benchmarks

518K 931 96
airspeed-velocity
asv-runner

Core pure python benchmarking for asv

398K 6 7
openml
openml

OpenML's Python API for a World of Data and More 💫

83K 350 269
IBM
opendsstar

OpenDsStar is an open-source implementation of the DS-Star agent that replaces file-based workflows with a flexible, tool-centric architecture. It supports incremental execution, reuses intermediate results, and makes complex multi-step agents more modular, efficient, and extensible.

44K 17 3
Jij-Inc
openjij

OpenJij : Framework for the Ising model and QUBO.

33K 126 34
NyanKiyoshi
pytest-django-queries

Generate performance reports from your django database performance tests.

32K 84 2
autogluon
fev

Forecast evaluation library

26K 161 17
google-research
rliable

[NeurIPS'21 Outstanding Paper] Library for reliable evaluation on RL and ML benchmarks, even with only a handful of seeds.

21K 872 49
blooop
holobench

A package for benchmarking the characteristics of arbitrary functions

17K 4 3
reframe-hpc
reframe-hpc

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

16K 275 122
salesforce
salesforce-merlion

Merlion: A Machine Learning Framework for Time Series Intelligence

13K 4K 357
arthur-ai
arthur-observability-sdk

Make AI work for Everyone - Monitoring and governing for your AI/ML

11K 80 10
sosy-lab
benchexec

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

10K 284 223
SID-Devu
isat-tuner

Inference Stack Auto-Tuner — one command to find the fastest ONNX inference config for any model on any GPU. Bayesian optimization, Pareto analysis, thermal-aware benchmarking, multi-provider (ROCm/CUDA/TensorRT/OpenVINO).

10K 0 0
Marker-Inc-Korea
autorag

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

8K 5K 395
mlcommons
cmind

Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to facilitate collaborative and reproducible research and to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks

5K 647 123
ant-research
easy-tpp

EasyTPP: Towards Open Benchmarking Temporal Point Processes

5K 343 46
lobocv
pyperform

An easy and convienent way to performance test python code.

4K 224 14
Helmholtz-AI-Energy
perun

Measure the energy used by your MPI+Python applications.

4K 92 6
uio-bmi
immuneml

immuneML is a platform for machine learning analysis of adaptive immune receptor repertoire data.

4K 74 30
clementchadebec
pythae

Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)

4K 2K 177
    • Data from PyPI, GitHub, ClickHouse, and BigQuery