Multiprocessing Python Packages

joblib

Computing with Python functions.

billiard

Multiprocessing Pool Extensions

multitasking

Non-blocking Python methods using decorators

aiomultiprocess

Take a modern Python codebase to the next level of performance.

trailrunner

Walk paths and run things

wrapt-timeout-decorator

Python Powerful Timeout Decorator that can be used safely on classes, methods, class methods

pebble

Multi threading and processing eye-candy.

vermin

Concurrently detect the minimum Python versions needed to run code

multiprocessing-logging

Handler for logging from multiple processes

lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

aioprocessing

A Python 3.5+ library that integrates the multiprocessing module with asyncio

schwimmbad

A common interface to processing pools.

executorlib

Up-scale python functions for high-performance computing (HPC)

atpbar

Progress bars for threading and multiprocessing tasks on terminal and Jupyter Notebook

mantichora

A simple interface to Python multiprocessing and threading

thread

A Python threading library extension

aioextensions

High performance functions to work with the async IO.

lox

Threading and Multiprocessing made easy.

pympipool

Up-scale python functions for high-performance computing (HPC)

streamable

sync/async iterable streams for Python

py-sharedmemory

Optimized Python IPC: Uses shared memory to bypass multiprocessing queue I/O bottlenecks, ideal for large data (1MB+) in scientific computing, RL, etc. Reduces system load and improves latency

stress-injector

Python script, to inject memory, CPU and URL stress

deadpool-executor

A Python Process Pool Executor implementation that is harder to break

funboost

pip install funboost，python全功能分布式函数调度框架,funboost的功能是全面性重量级，用户能想得到的功能99%全都有;funboost的使用方式是轻量级，只有@boost一行代码需要写。支持python所有类型的并发模式和一切知名消息队列中间件，支持如 celery dramatiq等框架整体作为funboost中间件，python函数加速器，框架包罗万象，用户能想到的控制功能全都有。一统编程思维，兼容50% python业务场景，适用范围广。只需要一行代码即可分布式执行python一切函数，99%用过funboost的pythoner 感受是　简易 方便 自由 强大，相见恨晚 。