Cuda Python Packages

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

numba

NumPy aware dynamic Python compiler using LLVM

nvidia-nccl-cu12

Optimized primitives for collective multi-GPU communication

ctranslate2

Fast inference engine for Transformer models

catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

nvidia-cutlass-dsl

CUDA Templates and Python DSLs for High-Performance Linear Algebra

nvidia-cutlass-dsl-libs-base

CUDA Templates and Python DSLs for High-Performance Linear Algebra

flashinfer-python

FlashInfer: Kernel Library for LLM Serving

cupy-cuda12x

NumPy & SciPy for GPU

nvidia-cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

torchao

PyTorch native quantization and sparsity for training and inference

flashinfer-cubin

FlashInfer: Kernel Library for LLM Serving

cog

Containers for machine learning

open3d

Open3D: A Modern Library for 3D Data Processing

nvidia-cutlass-dsl-libs-cu13

CUDA Templates and Python DSLs for High-Performance Linear Algebra

warp-lang

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

pennylane-lightning

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

cupy-cuda13x

NumPy & SciPy for GPU

openequivariance

OpenEquivariance: a fast, open-source GPU JIT kernel generator for the Clebsch-Gordon Tensor Product.

sglang-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

libcudf-cu12

cuDF - GPU DataFrame Library

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

hip-python

HIP Python Low-level Bindings