Gpu Monitoring Python Packages

openlit

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

jetson-stats

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

epokio

Phone alerts when an ML training run stalls, hits NaN or finishes, from the logs it already writes. No code changes, no account.

hardview

A hardware monitoring project that provides high-performance tools, Python libraries, and C++ header files for retrieving and displaying detailed hardware information.

actop

Apple Silicon (M1–M4) power, GPU, ANE & memory-bandwidth monitor — sudoless TUI + Python API for profiling local LLM / MLX / CoreML inference

graphsignal

GPU Profiler for AI agents

stormlog

GPU memory profiler for PyTorch, JAX & TensorFlow — real-time monitoring, leak detection, OOM flight recording, distributed analysis, and interactive TUI.

skyportalai

SkyPortal SDK & CLI

slurmwatch

Is your Slurm job actually using what you asked for? Watch it live.

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

telescope-ui

Real-time observability dashboard for the Telescope RL post-training framework. Monitor metrics, rollouts, traces, GPU infrastructure, and evals at scale.

wattameter

Python package for monitoring and recording power usage, energy consumption, and performance metrics from hardware components such as GPUs and CPUs

nvitop-exporter

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

llm-inspector

The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.

gpuview

A lightweight web dashboard for monitoring GPU usage

modaltrace

OpenTelemetry observability for real-time AI video pipelines

l9gpu

GPU Observability with workload attribution. One OTLP agent per node ties hardware metrics (NVIDIA, AMD, Intel Gaudi) to the K8s pod or Slurm job burning the GPU.

constella-gpu

Lightweight realtime heterogeneous accelerator monitoring with workload history.

omnismi

Cross-vendor GPU observability for AI agents and Python apps

rickslab-gpu-utils

A set of utilities for monitoring and customizing GPU performance

cordatus-jtop-service

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

triage-runner

Script running tool for optimizing GPU memory utilization

gpu-usage-audit

Single-host daemon that surfaces 'idle-held' NVIDIA GPU memory — the embarrassing category conventional dashboards miss.