Amd Gpu Python Packages

openlit

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

genai-otel-instrument

GenAI OpenTelemetry Auto-Instrumentation Library A comprehensive wrapper for automatic instrumentation of LLM/GenAI applications Supports all major LLM providers and MCP (Model Context Protocol) tool calls

make-localllm-easier

One command runs the best local LLM your GPU can handle: model picked from measured multilingual benchmarks, llama.cpp tuned for AMD, NVIDIA, Intel and Apple GPUs.

hyperloom-inference-optimizer

An agentic system that auto-optimizes LLM workloads on AMD GPUs.

strix-halo-jax

Run JAX and MuJoCo MJX on AMD Ryzen AI MAX (Strix Halo, gfx1151) from pip wheels - no system ROCm - with a hang-safe check that tells you which wheel set works

zllm-zse

The inference engine the open-source world built for itself.

picomon

Beautiful TUI dashboard for monitoring GPUs (AMD, NVIDIA, Apple Silicon)

gfxgraph

Drop-in CUDA Graph → HIP Graph translation layer for AMD RDNA2 (gfx1030/1031): safe eager fallback, dynamic-shape bucketing, DeepSpeed-HIP kernels, and a 3-tier illegal-memory-access GUARD for ROCm.

wave-gpu

A universal GPU ISA with a compiler, emulator, and backends for Apple, NVIDIA, AMD, and Intel GPUs.

zse-compiler

The inference engine the open-source world built for itself.

zse-engine

The inference engine the open-source world built for itself.

vulkan-ilm

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).

gpu-doctor

Universal GPU setup for PyTorch and JAX — DirectML, ROCm, CUDA, MPS, CPU. Auto-detects hardware, fixes HSA_OVERRIDE_GFX_VERSION for AMD RX 5700 XT. Beats devicetorch + torchruntime combined.