Parallel Computing Python Packages

joblib

Computing with Python functions.

ctranslate2

Fast inference engine for Transformer models

swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

mpi4py

Python bindings for MPI

pqdm

Comfortable parallel TQDM using concurrent.futures

pyopencl

OpenCL integration for Python, plus shiny features

arm-mango

Parallel Hyperparameter Tuning in Python

adaptive

:chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions

pipefunc

Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪

bodo

High Performance Data Processing in Python

imops

Efficient parallelizable algorithms for multidimensional arrays to speed up your data pipelines

schwimmbad

A common interface to processing pools.

pygmo

A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.

adaptive-scheduler

Run many functions (adaptively) on many cores (>10k-100k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. :tada:

cuda-cccl

CUDA Core Compute Libraries

tensorpac

Phase-Amplitude Coupling under Python

pydisort

Modern Python & C++ API for the radiative transfer solver DISORT. Parallelized with PyTorch tensors; compile-free with: pip install pydisort.

ultranest

Fit and compare complex models reliably and rapidly. Advanced nested sampling.

optuna-distributed

Distributed hyperparameter optimization made easy

mtkahypar

Mt-KaHyPar (Multi-Threaded Karlsruhe Hypergraph Partitioner) is a shared-memory multilevel graph and hypergraph partitioner equipped with parallel implementations of techniques used in the best sequential partitioning algorithms. Mt-KaHyPar can partition extremely large hypergraphs very fast and with high quality.

psyclone

PSyclone is a source-to-source Fortran compiler designed to programmatically optimise, parallelise and instrument HPC applications via user-provided transformation scripts.

hyperactive

A unified interface for optimization algorithms and experiments

optimagic

optimagic is a Python package for numerical optimization. It is a unified interface to optimizers from SciPy, NlOpt and other packages. optimagic's minimize function works just like SciPy's, so you don't have to adjust your code. You simply get more optimizers for free. On top you get diagnostic tools, parallel numerical derivatives and more.

pmmc

Mesh-based Monte Carlo (MMC)