Parallelism Python Packages

tbb

oneAPI Threading Building Blocks (oneTBB)

cache-dit

A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.

tbb-devel

oneAPI Threading Building Blocks (oneTBB)

portal

Fast and reliable distributed systems in Python

paxml

Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.

async-channel

Python async multi-task communication library. Used by OctoBot projects.

tbb4py

oneAPI Threading Building Blocks (oneTBB)

octobot-channels

Python async multi-task communication library. Used by OctoBot projects.

cache-dit-cu13

A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.

detox

distributed tox (tox plugin to run testenvs in parallel)

central-mcp

Central station for multi project management using mcp and cli wrapper

free-threading

Thread-first true parallelism for Python

riko

A stream processing engine modeled after Yahoo! Pipes.

tabular-ml-toolkit

A helper library to jumpstart your machine learning project based on tabular or structured data.

torchgpipe

A GPipe implementation in PyTorch

acatrack-pdf-parser-rs

High-performance, native parallel Rust PDF parser engine for VTU provisional results

asyncpal

Parallelism and preemptive concurrency for sporadic workloads

syntax-sugar

A library adding some anti-Pythonic syntatic sugar to Python

bftool-pkg-sulcud

A custom worker pool to handle the distribution of function between threads and processes

fastiter

Parallel iterators for Python 3.14+

zerofun

Remote function calls for array data using ZMQ

lbaf

Analysis framework for exploring, testing, and comparing load balancing strategies

pyeventbus

Python Eventbus

distrifuser

DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models