Parallel Python Packages

tqdm

:zap: A Fast, Extensible Progress Bar for Python and CLI

lightgbm

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

optuna

A hyperparameter optimization framework

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

highspy

Linear optimization software

pytest-parallel

A pytest plugin for parallel and concurrent testing

parallel-ssh

Asynchronous parallel SSH client library.

concurrencytest

Python - Run unittest test suites concurrently

pennylane-lightning

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

rapidgzip

Gzip Decompression and Random Access for Modern Multi-Core Machines

portal

Fast and reliable distributed systems in Python

behavex

Production-grade test orchestration for Python BDD.

lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides a universal API for building parallel applications in the cloud ☁️🚀

tdqm

:zap: A Fast, Extensible Progress Bar for Python and CLI

edt

Euclidean distance & signed distance transform for multi-label 3D anisotropic images using marching parabolas.

cloud-files

Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.

ray-cpp

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

indexed-bzip2

Fast parallel random access to bzip2 and gzip files in Python

shelljob

Python process and file system module

ant-ray-cpp-nightly

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

adaptive

:chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions

agentdescent

Gradient descent, but the parameters are agents — a parallel, asynchronous framework for self-evolving agents (skills, prompts, harnesses). Diffs are the gradients; the aggregator is the optimizer.

cogent3

Comparative Genomics Toolkit 3

wickra-screener

Parallel multi-symbol screener: scan thousands of symbols against data-driven conditions over 497 O(1) streaming indicators.