Load Balancer Python Packages

airflow-balancer

Utilities for tracking hosts and ports and load balancing DAGs

vmware-avi

AVI (NSX Advanced Load Balancer) management and AKO Kubernetes operations tool

huddle-cluster

High-performance distributed load balancer.

ollama-herd

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

openstack-lb-treeview

Displays a tree view of all loadbalancers in an OpenStack project, showing pools and members in a hierarchical structure

openai-priority-loadbalancer

Smart Python OpenAI Load Balancer using priority endpoints and request retries. | Python package at link below:

nya-proxy

NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI tools (like OpenAI, Gemini, Anthropic), image generators, or almost any web service that uses access keys. It helps you use these services more reliably, efficiently, and securely.

multihull

Deploy always-warm GPU inference containers to many providers from one spec. One URL, automatic per-request failover. Built for reliability over cost.

rolter

(WIP) High-performance OpenAI/Anthropic-compatible AI gateway + load balancer in Rust (LiteLLM-proxy alternative)

f5-openstack-lbaasv2-driver

F5 LBaaSv2 service provider driver for OpenStack Liberty and beyond

paddler-client

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

berserker-resolver

Fast mass dns resolver

openbalancer

Lightweight asynchronous reverse proxy and load balancer with health checks, circuit breaker, and Prometheus metrics. MIT licensed.

pymako

A Consul Client for Python.

pyalb

A load balancer implementation from scratch in python

elb-py

Eru load balancer

sharkradar

Lightweight micro service registry and discovery tool, compatible with any HTTP based microservice

pyloadbalancer

A load balancer for Python 3.5