Cuda Python Packages

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

numba

NumPy aware dynamic Python compiler using LLVM

nvidia-nccl-cu12

Optimized primitives for collective multi-GPU communication

ctranslate2

Fast inference engine for Transformer models

catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

flashinfer-python

FlashInfer: Kernel Library for LLM Serving

nvidia-cutlass-dsl

CUDA Templates and Python DSLs for High-Performance Linear Algebra

nvidia-cutlass-dsl-libs-base

CUDA Templates and Python DSLs for High-Performance Linear Algebra

flashinfer-cubin

FlashInfer: Kernel Library for LLM Serving

torchao

PyTorch native quantization and sparsity for training and inference

nvidia-cudnn-frontend

cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it

cupy-cuda12x

NumPy & SciPy for GPU

cog

Containers for machine learning

torchrec

Pytorch domain library for recommendation systems

open3d

Open3D: A Modern Library for 3D Data Processing

warp-lang

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

pennylane-lightning

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

openequivariance

OpenEquivariance: a fast, open-source GPU JIT kernel generator for the Clebsch-Gordon Tensor Product.

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

cupy-cuda13x

NumPy & SciPy for GPU

sglang-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

sgl-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

pylibcudf-cu12

cuDF - GPU DataFrame Library