Amd Gpu Python Packages

openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

genai-otel-instrument

GenAI OpenTelemetry Auto-Instrumentation Library A comprehensive wrapper for automatic instrumentation of LLM/GenAI applications Supports all major LLM providers and MCP (Model Context Protocol) tool calls

zllm-zse

The inference engine the open-source world built for itself.

gfxgraph

Drop-in CUDA Graph → HIP Graph translation layer for AMD RDNA2 (gfx1030/1031): safe eager fallback, dynamic-shape bucketing, DeepSpeed-HIP kernels, and a 3-tier illegal-memory-access GUARD for ROCm.

picomon

Beautiful TUI dashboard for monitoring GPUs (AMD, NVIDIA, Apple Silicon)

zse-compiler

The inference engine the open-source world built for itself.

zse-engine

Zero-dependency LLM inference engine. Fastest cold start, smallest VRAM footprint. CUDA + ROCm + Metal.

vulkan-ilm

Pythonic LLM inference on legacy GPUs using Vulkan — GPU-accelerated local AI for AMD, Intel, and NVIDIA without CUDA.

gpu-doctor

Universal GPU setup and diagnostics for PyTorch and JAX — DirectML, ROCm, CUDA, MPS, CPU. Auto-detects your hardware and sets HSA_OVERRIDE_GFX_VERSION for unsupported AMD GPUs.