Gpu Monitoring Python Packages

openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

jetson-stats

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

hardview

A hardware monitoring project that provides high-performance tools, Python libraries, and C++ header files for retrieving and displaying detailed hardware information.

nvitop-exporter

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

stormlog

GPU memory profiler for PyTorch & TensorFlow — real-time monitoring, leak detection, OOM flight recording, distributed analysis, and interactive TUI.

telescope-ui

Real-time observability dashboard for the Telescope RL post-training framework. Monitor metrics, rollouts, traces, GPU infrastructure, and evals at scale.

gpu-usage-audit

Single-host daemon that surfaces 'idle-held' NVIDIA GPU memory — the embarrassing category conventional dashboards miss.

triage-runner

Script running tool for optimizing GPU memory utilization.

picomon

Beautiful TUI dashboard for monitoring GPUs (AMD, NVIDIA, Apple Silicon)

modaltrace

OpenTelemetry observability library for real-time AI applications

gpusitter

Watch for idle GPUs and run your jobs: launches jobs in tmux, keeps logs/status and sends start/finish emails..

kempnerpulse

KempnerPulse - real-time GPU monitoring dashboard for DCGM metrics.

gpuview

A lightweight web dashboard for monitoring GPU usage

rickslab-gpu-utils

A set of utilities for monitoring and customizing GPU performance

nvsonar

Active GPU diagnostic tool that identifies performance bottlenecks

wattameter

Python package for monitoring and recording power usage, energy consumption, and performance metrics from hardware components such as GPUs and CPUs

cordatus-jtop-service

Interactive system-monitor and process viewer for all NVIDIA Jetson [Orin, Xavier, Nano, TX] series

nvitop-musa

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

cuda-selector

A simple tool to select the optimal CUDA device based custom criteria.

gpu-overseer

Telegram notifier for GPU availability status.

apple-gpu

Package for measuring GPU utilisation on Mac OS

jetson-stats-customized

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series