Ascend Python Packages

uc-manager

Persist and reuse KV Cache to speedup your LLM.

vllm-ascend

Community maintained hardware plugin for vLLM on Ascend

nndeploy

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

torch-rechub

A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

llm-cal

LLM inference hardware calculator — architecture-aware, engine-version-aware, honest-labeled.

ascend-nputop

An interactive Ascend-NPU process viewer.

cmq-test

Community maintained hardware plugin for vLLM on Ascend