Benchmarking Framework Python Packages

pyrddlgym

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

optiprofiler

Benchmarking optimization solvers.

tracecore

Deterministic runtime for agent evaluation

mlos-bench

MLOS is a project to enable autotuning for systems.

arline-benchmarks

Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes

mlos-core

MLOS is a project to enable autotuning for systems.

fseval

Benchmarking framework for Feature Selection and Feature Ranking algorithms 🚀

mlos-viz

MLOS is a project to enable autotuning for systems.

pyexpool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture