Parallelism Python Packages

tbb

oneAPI Threading Building Blocks (oneTBB)

cache-dit

A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.

tbb-devel

oneAPI Threading Building Blocks (oneTBB)

portal

Fast and reliable distributed systems in Python

paxml

Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.

octobot-channels

Python async multi-task communication library. Used by OctoBot projects.

central-mcp

Central station for multi project management using mcp and cli wrapper

tbb4py

oneAPI Threading Building Blocks (oneTBB)

async-channel

Python async multi-task communication library. Used by OctoBot projects.

detox

distributed tox (tox plugin to run testenvs in parallel)

parajax

⚡ Automatic vectorization and parallelization of JAX-based functions

tbb4u

oneAPI Threading Building Blocks (oneTBB)

cache-dit-cu13

A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.

free-threading

Thread-first true parallelism for Python

tabular-ml-toolkit

A helper library to jumpstart your machine learning project based on tabular or structured data.

torchgpipe

A GPipe implementation in PyTorch

sandbox-fan-out

Fan work out across parallel agents, each in an isolated clone with its own log, then merge in one safe single-writer pass. Standard library only.

pyeventbus

Python Eventbus

zerofun

Fast and reliable distributed systems in Python

bftool-pkg-sulcud

A custom worker pool to handle the distribution of function between threads and processes

asyncpal

Parallelism and preemptive concurrency for sporadic workloads

acatrack-pdf-parser-rs

A high-performance, native Rust PDF parsing engine designed specifically to extract structured academic student records and provisional exam marks. Bridged seamlessly to Python via PyO3 and Maturin, it leverages multi-threaded CPU parallel processing via Rayon to slash batch ingestion processing times.

syntax-sugar

A library adding some anti-Pythonic syntatic sugar to Python

lbaf

Analysis framework for exploring, testing, and comparing load balancing strategies