Multigpu Python Packages

warmup-scheduler

Gradually-Warmup Learning Rate Scheduler for PyTorch

tokenspeed-iris

AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

tomobar

TOmographic MOdel-BAsed Reconstruction (ToMoBAR) software

jax-hpc-profiler

A comprehensive benchmarking and profiling tool designed for JAX in HPC environments, offering automated instrumentation, strong/weak scaling analysis, and performance visualization.

distributed-compy

Distributed_compy is a distributed computing library that offers multi-threading, heterogeneous (CPU + mult-GPU), and multi-node support