PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Npu Python Packages

Python packages with the GitHub topic npu. Sorted by relevance, with stars and monthly downloads.
rbln-sw
optimum-rbln

⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.

36K 18 5
ModelCloud
device-smi

Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it yourself.

25K 15 1
ModelEngine-Group
uc-manager

Persist and reuse KV Cache to speedup your LLM.

8K 277 74
mobilint
mblt-tracker

A lightweight Python library for tracking hardware metrics (Power, Utilization, Memory) across CPU, GPU, and NPU.

3K 6 1
datawhalechina
torch-rechub

A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

2K 1K 145
batuhanberkayaydin
rockchip-stats

Interactive system-monitor and process viewer for Rockchip SoC devices [RK3588, RK3588S, RK3568, RK3566, RK3399]

1K 4 0
Tetramatrix
lemonade-python-sdk

A clean interface for interacting with the Lemonade LLM server

1K 6 0
emapco
rk-transformers

Export and Run Hugging Face Transformers Models on Rockchip NPUs

1K 25 2
youyve
ascend-nputop

An interactive Ascend-NPU process viewer.

429 130 11
Sipeed
maixtool

C/C++ development kit for Sipeed Maix ecosystem boards

417 121 47
boundarybitlabs
rknn-inspect

A tool for inspecting RKNN models

196 6 0
James-Crockett
nexil

A better way to run LLMs locally on Intel hardware (NPU or CPU) with a single command.

173 1 0
janelu9
jllm

Running Large Language Model easily, faster and low-cost.

102 13 5
pberlizov
vimin-core

Source-available local AI inference orchestration — broadcast dispatch and multi-step pipelines across up to 10 nodes

98 0 0
aurintex
pai-sdk

Reserved for PAI-OS SDK

87 5 0
Sipeed
maixcdk-example

C/C++ development kit for Sipeed Maix ecosystem boards

86 121 47
Sipeed
maixcdk

C/C++ development kit for Sipeed Maix ecosystem boards

43 121 47
    • Data from PyPI, GitHub, ClickHouse, and BigQuery