Load Balancing Python Packages

pytest-balance

Intelligent test distribution for pytest based on actual execution times, not file count

radlab-llm-router

LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).

mx-multiplexer

Lightweight, stateless message broker for request/reply and publish/subscribe between services on a trusted internal network. Declarative routing rules: round-robin load balancing, fan-out, direct addressing. C++17 core, C++ and Python client libraries, active-active redundancy. In production since 2008.

grpc-client-kit

Batteries-optional async gRPC client toolkit (channel pool, load balancing, health checking, streaming-aware interceptors, observability)

rotapool

Generic async resource pool with rotation, cooldown, and retry

carrot-mops

基于 mDNS 自动发现的分布式代理负载均衡系统 — Multi-node Outbound Proxy System

kronos-openstack

PromQL-driven VM placement optimization engine for OpenStack: policies are raw Prometheus queries; the engine plans Nova live migrations to balance or pack host aggregates.

nudnik

Nudnik - Infrastructure Fuzzing

flockparser

Distributed document RAG with VRAM-aware workload placement across heterogeneous nodes. Four interfaces: CLI, API, MCP, Web UI.

pyexpool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

loco-agent

Open-source scheduling and cost-governance layer for agent fleets, evolving toward a control plane for monitored agent operations.

lbaf

Analysis framework for exploring, testing, and comparing load balancing strategies

tokenbiryani

A pooling gateway for Claude accounts: one Anthropic-compatible endpoint, cache-aware routing across every credential you own.

closecode

Close Code: A terminal-native AI coding agent powered by LLMesh, with multi-model routing, tool execution, context management, and agentic workflows.

pymako

A Consul Client for Python.

pyroxi

High-performance Python proxy library with SOCKS5/HTTP, async, and zero dependencies.

coord-sim

Lightweight flow-level simulator for inter-node network and service coordination (e.g., in cloud/edge computing or NFV).

moewatch

👻 MoEWatch: A lightweight diagnostic and audit library for Mixture-of-Experts (MoE) models in HuggingFace Transformers — the pytest for MoE models.