PyRank

Benchmarks Python Packages

Python packages with the GitHub topic benchmarks. Sorted by relevance, with stars and monthly downloads.
wseaton
sqloxide

Python bindings for sqlparser-rs

589K 211 27
mims-harvard
pytdc

Therapeutics Commons (TDC): Multimodal Foundation for Therapeutic Science

119K 1K 219
Andyyyy64
whichllm

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

53K 6K 293
NVIDIA-NeMo
nemo-gym

Evaluate and improve models and agents using environments

11K 1K 213
OpenAdaptAI
openadapt-evals

Evaluation infrastructure for GUI agent benchmarks

8K 1 3
squaresLab
bugzoo

Keep your bugs contained. A platform for studying historical software bugs.

7K 70 12
Kaia-Alenia
alenia-zenith

Zero-latency boot infrastructure for Python 3.14+ utilizing speculative dependency pre-loading and free-threading.

4K 1 0
flatland-association
fab-clientlib

Flatland Benchmarks (FAB) is an open-source web-based platform for running Benchmarks to foster Open Research

3K 3 3
Pacific-AI-Corp
langtest

Deliver safe & effective language models

3K 562 50
JohnSnowLabs
nlptest

Deliver safe & effective language models

3K 562 50
optiprofiler
optiprofiler

Benchmarking optimization solvers.

3K 15 4
ContinualAI
avalanche-lib

Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

3K 2K 320
altaiiiir
harborforge

Forge Harbor task directories from any evaluation benchmark

2K 1 0
pyrddlgym-project
rddlrepository

Hosts domain and instance RDDL files, covering problems from a wide range of disciplines, integration with the pyRDDLGym ecosystem.

2K 14 5
gashel01
mcpaisuite-evalmcp

Evaluation for AI agents — judge-based scoring and native RAG metrics (faithfulness, relevancy, context precision/recall). Python lib · CLI · MCP server · FastAPI.

2K 0 0
scailfin
flowserv-core

Reproducible and Reusable Data Analysis Workflow Server

1K 2 0
Arech
benchstats

Statistical Testing for Benchmark Results Comparison

1K 4 0
averinpa
dagsampler

Constraint-based causal discovery: simulator (dagsampler), CI tests (citk), algorithms (cbcd), metrics & viz (bnm)

1K 0 0
orsinium-labs
true-north

🧭 Powerful and Pythonic framework for reproducible benchmarks of Python code.

1K 8 0
WaterFutures
water-benchmark-hub

A platform for accessing and sharing Water Distribution Network benchmarks and data sets

1K 23 8
matrixji
annb

A simple ANN benchmark tools

765 1 1
wseaton
datazip-sqloxide

Python bindings for sqlparser-rs

662 211 27
Carglglz
upydev

Command line tool for MicroPython devices

628 59 9
vikashplus
robohive

A Unified Framework for Robot Learning

587 628 96