Amd Gpu Python Packages

openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

genai-otel-instrument

GenAI OpenTelemetry Auto-Instrumentation Library A comprehensive wrapper for automatic instrumentation of LLM/GenAI applications Supports all major LLM providers and MCP (Model Context Protocol) tool calls

zllm-zse

The inference engine the open-source world built for itself.

picomon

Beautiful TUI dashboard for monitoring GPUs (AMD, NVIDIA, Apple Silicon)

gpu-doctor

Universal GPU setup for PyTorch and JAX — DirectML, ROCm, CUDA, MPS, CPU. Auto-detects hardware, fixes HSA_OVERRIDE_GFX_VERSION for AMD RX 5700 XT. Beats devicetorch + torchruntime combined.

vulkan-ilm

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).