cgroups
BenchExec: A Framework for Reliable Benchmarking and Resource Measurement
metric collectors for various stuff not (or poorly) handled by other monitoring daemons
Python binding for libcgroup
PyMergen is a configuration-driven test automation tool for Linux.