Gpu Monitoring Python Packages

openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

jetson-stats

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

hardview

A hardware monitoring project that provides high-performance tools, Python libraries, and C++ header files for retrieving and displaying detailed hardware information.

actop

Apple Silicon (M1–M4) power, GPU, ANE & memory-bandwidth monitor — sudoless TUI + Python API for profiling local LLM / MLX / CoreML inference

lindoze

A Linux system monitor with the layout of Windows 11 Task Manager.

gpu-usage-audit

Single-host daemon that surfaces 'idle-held' NVIDIA GPU memory — the embarrassing category conventional dashboards miss.

nvitop-exporter

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

stormlog

GPU memory profiler for PyTorch, JAX & TensorFlow — real-time monitoring, leak detection, OOM flight recording, distributed analysis, and interactive TUI.

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

telescope-ui

Real-time observability dashboard for the Telescope RL post-training framework. Monitor metrics, rollouts, traces, GPU infrastructure, and evals at scale.

nvsonar

Active GPU diagnostic tool that identifies performance bottlenecks, detects anomalous patterns, and gives actionable recommendations

modaltrace

OpenTelemetry observability for real-time AI video pipelines

triage-runner

Script running tool for optimizing GPU memory utilization.

gpuview

A lightweight web dashboard for monitoring GPU usage

gpualert

Monitor GPU jobs, detect failures, and stay informed during long-running ML experiments.

kempnerpulse

KempnerPulse - real-time GPU monitoring dashboard for DCGM metrics.

wattameter

Python package for monitoring and recording power usage, energy consumption, and performance metrics from hardware components such as GPUs and CPUs

cordatus-jtop-service

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

picomon

Beautiful TUI dashboard for monitoring GPUs (AMD, NVIDIA, Apple Silicon)

jetson-stats-customized

Interactive system-monitor and process viewer for all NVIDIA Jetson [Orin, Xavier, Nano, TX] series

gpusitter

Watch for idle GPUs and run your jobs: launches jobs in tmux, keeps logs/status and sends start/finish emails..

nvitop-musa

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

rickslab-gpu-utils

A set of utilities for monitoring and customizing GPU performance