PyRank

Cuda Python Packages

Python packages with the GitHub topic cuda. Sorted by monthly downloads, with stars and forks.
OpenNMT
ctranslate2

Fast inference engine for Transformer models

15M 5K 547
catboost
catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

5.7M 9K 1K
NVIDIA
nvidia-cutlass-dsl-libs-base

CUDA Templates and Python DSLs for High-Performance Linear Algebra

4.7M 11K 2K
NVIDIA
nvidia-cutlass-dsl

CUDA Templates and Python DSLs for High-Performance Linear Algebra

4.1M 11K 2K
NVIDIA
nvidia-cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

3.4M 965 304
flashinfer-ai
flashinfer-python

FlashInfer: Kernel Library for LLM Serving

3.1M 7K 2K
NVIDIA
nvidia-cutlass-dsl-libs-cu13

CUDA Templates and Python DSLs for High-Performance Linear Algebra

3M 11K 2K
NVIDIA
nvidia-cutlass-dsl-libs-cu12

CUDA Templates and Python DSLs for High-Performance Linear Algebra

2.9M 11K 2K
NVIDIA
nvidia-cutlass-dsl-libs-core

CUDA Templates and Python DSLs for High-Performance Linear Algebra

2.7M 11K 2K
sgl-project
sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

2.5M 37K 10K
pytorch
torchao

PyTorch native quantization for training and inference

2.2M 3K 646
vllm-project
vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

2.1M 94K 23K
NVIDIA
nccl4py

Optimized primitives for collective multi-GPU communication

1.6M 5K 1K
isl-org
open3d

Open3D: A Modern Library for 3D Data Processing

1.4M 14K 3K
cupy
cupy-cuda12x

NumPy & SciPy for GPU

1.3M 12K 1K
NVIDIA
warp-lang

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

1.3M 7K 651
replicate
cog

Containers for machine learning

1.2M 9K 698
flashinfer-ai
flashinfer-cubin

FlashInfer: Kernel Library for LLM Serving

1.2M 7K 2K
sgl-project
sglang-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

813K 37K 10K
cupy
cupy-cuda13x

NumPy & SciPy for GPU

425K 12K 1K
PennyLaneAI
pennylane-lightning

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

288K 146 60
NVIDIA
libcudf-cu12

cuDF - GPU DataFrame Library

243K 10K 1K
rapidsai
librmm-cu12

NVIDIA RMM is a library for allocating and managing GPU memory in C++ and Python.

234K 734 261
NVIDIA
libcuml-cu12

NVIDIA cuML: GPU-Accelerated Machine Learning

232K 5K 687