Parallel Python Packages

tqdm

:zap: A Fast, Extensible Progress Bar for Python and CLI

numba

NumPy aware dynamic Python compiler using LLVM

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

lightgbm

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

optuna

A hyperparameter optimization framework

highspy

Linear optimization software

pennylane-lightning

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

pytest-parallel

A pytest plugin for parallel and concurrent testing

concurrencytest

Python - Run unittest test suites concurrently

parallel-ssh

Asynchronous parallel SSH client library.

tdqm

:zap: A Fast, Extensible Progress Bar for Python and CLI

lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

behavex

Production-grade test orchestration for Python BDD.

edt

Euclidean distance & signed distance transform for multi-label 3D anisotropic images using marching parabolas.

rapidgzip

Gzip Decompression and Random Access for Modern Multi-Core Machines

portal

Fast and reliable distributed systems in Python

adaptive

:chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions

ant-ray-cpp-nightly

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

indexed-bzip2

Fast parallel random access to bzip2 and gzip files in Python

shelljob

Python process and file system module

cloud-files

Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.

pennylane-lightning-kokkos

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

pyallel

Run and handle the output of multiple executables in pyallel (as in parallel)

ray-cpp

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.