Load Balancing Python Packages

pytest-balance

Intelligent test distribution for pytest based on actual execution times, not file count

rotapool

Generic async resource pool with rotation, cooldown, and retry

loco-agent

Load-aware scheduling layer for multi-agent systems

flockparser

Distributed document RAG system with intelligent GPU/CPU orchestration. Auto-discovers heterogeneous nodes, routes workloads adaptively, and achieves 60x+ speedups through VRAM-aware load balancing. Privacy-first architecture with 4 interfaces (CLI, API, MCP, Web UI). Real distributed systems engineering, not just an API wrapper.

nudnik

Nudnik - Infrastructure Fuzzing

anycastd

A daemon to manage anycasted services based on status checks.

moewatch

A lightweight diagnostic and audit library for Mixture-of-Experts (MoE) models in HuggingFace Transformers

pyexpool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

lbaf

Analysis framework for exploring, testing, and comparing load balancing strategies

pyroxi

High-performance Python proxy library with SOCKS5 and HTTP support, featuring multi-proxy load balancing, automatic failover, and binary networking protocols.

pymako

A Consul Client for Python.

coord-sim

Simulate flow-level, inter-node network coordination including scaling and placement of services and scheduling/balancing traffic between them.