Hardware Acceleration Python Packages

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-gpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-openvino

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-directml

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-ep-webgpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

oneiric

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-windowsml

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

ameva-runtime

Unified Next-Gen Hardware Orchestration & AI Acceleration Runtime for Mobile & Edge

onnxruntime-training

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

brevitas

Brevitas: neural network quantization in PyTorch

onnxruntime-tools

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-rocm

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

zigzag-dse

HW Architecture-Mapping Design Space Exploration Framework for Deep Learning Accelerators

onnxruntime-silicon

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-webgpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-gpu-extended

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

qkeras

QKeras: a quantization deep learning library for Tensorflow Keras

mediaway

High-performance native-first media engine: Zero-Copy paths (GPU/CPU handles), hardware offloading, sans-io mux/demux cores, permissive MIT OR Apache-2.0

onnxruntime-cann

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-training-cpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

ameva-vulkan-runtime

Unified Cross-Modal Vulkan GPU Acceleration Runtime & HAL for Mobile Android

onnxruntime-azure

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

aneforge

Python runtime for the Apple Neural Engine

onnxruntime-macavx

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator