Hardware Acceleration Python Packages

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-gpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-openvino

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-directml

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-tools

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

brevitas

Brevitas: neural network quantization in PyTorch

onnxruntime-training

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-qnn

onnxruntime-qnn is the Qualcomm AI Runtime (QAIRT) execution provider for onnxruntime. It provides onnxruntime hardware acceleration and advanced functionalities on Qualcomm devices.

onnxruntime-windowsml

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-webgpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-silicon

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-trt-rtx

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

oneiric

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-ep-webgpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

qkeras

QKeras: a quantization deep learning library for Tensorflow Keras

aneforge

Pythonic binding to the Apple Neural Engine

onnxruntime-cann

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-training-cpu

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-macavx

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

zigzag-dse

HW Architecture-Mapping Design Space Exploration Framework for Deep Learning Accelerators

onnxruntime-azure

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-powerpc64le

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-openmp

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

rockchip-stats

Interactive system-monitor and process viewer for Rockchip SoC devices [RK3588, RK3588S, RK3568, RK3566, RK3399]