Performance Evaluation Python Packages

vot-toolkit

The official VOT Challenge evaluation and analysis toolkit

statline

StatLine — Advanced weighted player scoring and analytics, with modular tools for awards, performance evaluation, and real-time integrations.

minimal-dataset-pytorch

Lightweight experimental PyTorch data-loading library with Parquet-backed datasets, concurrent loading, benchmarking and performance instrumentation.

model-confidence-set

Model Confidence Set (MCS) implementation in Python

pybenchkit

A declarative framework for composable performance evaluation of system software.

model-compare

model-compare evaluates AI models side‑by‑side based on user tasks, rating accuracy, creativity, and efficiency to guide model choice.