Gpu Python Packages

torch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

nvidia-nccl-cu12

Optimized primitives for collective multi-GPU communication

catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

apache-tvm-ffi

Open ABI and FFI for Machine Learning Systems

flashinfer-python

FlashInfer: Kernel Library for LLM Serving

stringzilla

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

nvidia-cutlass-dsl

CUDA Templates and Python DSLs for High-Performance Linear Algebra

gpustat

📊 A simple command-line utility for querying and monitoring GPU status

nvidia-cutlass-dsl-libs-base

CUDA Templates and Python DSLs for High-Performance Linear Algebra

flashinfer-cubin

FlashInfer: Kernel Library for LLM Serving

nvidia-cudnn-frontend

cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it

cupy-cuda12x

NumPy & SciPy for GPU

torchrec

Pytorch domain library for recommendation systems

skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

cuda-tile

cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

open3d

Open3D: A Modern Library for 3D Data Processing

warp-lang

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

runpod

🐍 | Python library for RunPod API and serverless worker SDK.

torch-model-archiver

Serve, optimize and scale PyTorch models in production

pennylane-lightning

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

fastai

The fastai deep learning library

qiskit-aer

Aer is a high performance simulator for quantum circuits that includes noise models