Npu Python Packages

optimum-rbln

⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.

device-smi

Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it yourself.

uc-manager

Persist and reuse KV Cache to speedup your LLM.

mblt-tracker

A lightweight Python library for tracking hardware metrics (Power, Utilization, Memory) across CPU, GPU, and NPU.

rk-transformers

Export and Run Hugging Face Transformers Models on Rockchip NPUs

torch-rechub

A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

lemonade-python-sdk

A production-grade Python SDK for the Lemonade LLM backend. Featuring auto-discovery, port scanning, and a low-overhead client architecture. Powering the Sorana AI workspace.

maixtool

Tools for Maix series development

npu-easy

npu-easy is a small, zero-hard-dependency wrapper around ONNX Runtime. It discovers installed execution providers, prefers an NPU, can fall back to a GPU or CPU, and reports exactly which provider is active.

ascend-nputop

An interactive Ascend-NPU process viewer

rockchip-stats

Interactive system-monitor and process viewer for Rockchip SoC devices [RK3588, RK3588S, RK3568, RK3566, RK3399]

nexil

A better way to run LLMs locally on Intel hardware (NPU or CPU) with a single command.

rknn-inspect

rknn-inspect shows model structure, ops, inputs and outputs, and performance information about rknn models.

maixcdk-example

C/C++ development kit for Sipeed Maix ecosystem boards

jllm

Running Large Language Model easily.

pai-sdk

Open-source AI wearable companion. Local-first multimodal perception (VLM & Audio) on Edge NPU. Built with Rust & Flutter.

vimin-core

Source-available local AI inference orchestration — broadcast dispatch and multi-step pipelines across up to 10 nodes

maixcdk

C/C++ development kit for Sipeed Maix ecosystem boards