Benchmarks Python Packages

sqloxide

Python bindings for sqlparser-rs

pytdc

Therapeutics Commons (TDC): Multimodal Foundation for Therapeutic Science

whichllm

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

avalanche-lib

Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

fab-clientlib

Flatland Benchmarks (FAB) is an open-source web-based platform for running Benchmarks to foster Open Research

openadapt-evals

Evaluation infrastructure for GUI agent benchmarks

bugzoo

A platform for safely studying historical software versions.

langtest

Deliver safe & effective language models

alenia-zenith

Zero-latency boot infrastructure for Python 3.14+ utilizing speculative dependency pre-loading and free-threading.

true-north

🧭 Powerful and Pythonic framework for reproducible benchmarks of Python code.

flowserv-core

Reproducible and Reusable Data Analysis Workflow Server

nlptest

Deliver safe & effective language models

upydev

Command line tool for MicroPython devices

annb

A simple ANN benchmark tools

rddlrepository

Hosts domain and instance RDDL files, covering problems from a wide range of disciplines, integration with the pyRDDLGym ecosystem.

benchstats

Statistical Testing for Benchmark Results Comparison

optiprofiler

Benchmarking optimization solvers.

nemo-gym

Evaluate and improve models and agents using environments

datazip-sqloxide

Python bindings for sqlparser-rs

dagsampler

Configurable causal DAG simulator for synthetic mixed-type data and CI test benchmarks

dz-sqloxide

Python bindings for sqlparser-rs

arline-benchmarks

Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes

robohive

A Unified Framework for Robot Learning

test-sqloxide

Python bindings for sqlparser-rs