Worker Pool Python Packages

sayiir

Durable workflow engine with Rust core and Python bindings — checkpointing, fork/join, distributed workers

redis-message-queue

Reliable Python message queuing with Redis and built-in deduplication. Publish once, process once, recover from crashes - across any number of producers and consumers.

meesee

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

flowrhythm

Asynchronous job processing framework with dynamic worker scaling

mic-worker

Worker package for async tasks

werkpool

A Python worker pool allowing rate and concurrency control

pipeline-factory

Pipeline Factory is a Python server framework to define, manage, schedule and execute custom defined code pipelines and series of pipeline across multiple worker processes.

dogdorm

Custom server uptime monitor for STUN, TURN, MQTT, and NTP

django-pdf-reactor

Async PDF generation in Django Channels worker or with Django 3.1 async views

zmeyweb

A platform to programmatically author, schedule, and monitor workflows