Worker Pool Python Packages

sonicprobe

Python infrastructure utilities for worker pools, configuration, networking, SQL access, filesystem operations and process management.

sayiir

Sayiir: simple, embeddable durable workflow engine in Rust with Node.js & Python bindings. Checkpoint-based recovery, no deterministic replay. A simplified alternative to Temporal, Restate, and Airflow.

meesee

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

redis-message-queue

Lightweight Python message queuing with Redis and built-in publish-side deduplication.

behave-pool

Parallel test execution for Behave BDD via native ITestRunner. Process-isolated workers with spawn start method, LPT load balancing, and @serial tag support.

tinyjobs

Background jobs and cron for Python, on SQLite, with zero dependencies

asyncqueue-py

This project demonstrates asynchronous task processing in Python using asyncio. It includes different methods for processing tasks in batches and with a custom asynchronous queue class.

tg-guard

Lightweight, decorator-first task routing for Python.

werkpool

A Python worker pool allowing rate and concurrency control

flowrhythm

Asynchronous job processing framework with dynamic worker scaling

dogdorm

Custom server uptime monitor for STUN, TURN, MQTT, and NTP

django-pdf-reactor

Async PDF generation in Django Channels worker or with Django 3.1 async views

pipeline-factory

Pipeline Factory is a Python server framework to define, manage, schedule and execute custom defined code pipelines and series of pipeline across multiple worker processes.

zmeyweb

A platform to programmatically author, schedule, and monitor workflows

zmey

A platform to programmatically author, schedule, and monitor workflows