Multi Gpu Python Packages

heat

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

torchdr

TorchDR - PyTorch Dimensionality Reduction

gradient-accumulator

Package for gradient accumulation in TensorFlow

flash-mineru

Ray-powered accelerator for MinerU, turning PDF → Markdown into a scalable, cluster-ready data infrastructure. 基于 Ray 的 MinerU 加速层，将 PDF → Markdown 构建为可扩展、面向集群的数据基础设施。

tensordiffeq

Distributed PDE Solver in Tensorflow

cudamps

Python interface to CUDA Multi-Process Service