Benchmarking Framework Python Packages

optiprofiler

Benchmarking optimization solvers.

pyrddlgym

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

mlos-core

MLOS is a project to enable autotuning for systems.

urbanmarl

Vectorized urban multi-agent reinforcement learning for 6G geospatial and radio digital twins.

tracecore

Deterministic runtime for agent evaluation

fseval

Benchmarking framework for Feature Selection and Feature Ranking algorithms 🚀

mlos-bench

MLOS is a project to enable autotuning for systems.

pyexpool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

arline-benchmarks

Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes

mlos-viz

MLOS is a project to enable autotuning for systems.