Load Balancer Python Packages

airflow-balancer

Utilities for tracking hosts and ports and load balancing DAGs

ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

nya-proxy

A lightweight, flexible API proxy with dynamic token rotation, load balancing, and rate limiting capabilities.

paddler-client

Python client for Paddler LLM load balancer

openai-priority-loadbalancer

A multi-backend, prioritization load balancer for OpenAI

f5-openstack-lbaasv2-driver

F5 LBaaSv2 service provider driver for OpenStack Liberty and beyond

huddle-cluster

Penguin-inspired self-organizing server load balancer. Servers rotate between an active inner ring and a resting outer ring based on EMA-smoothed temperature scores — no central coordinator needed.

berserker-resolver

Fast mass dns resolver which can bypass loadbalancers

sharkradar

Lightweight micro service registry and discovery tool, compatible with any HTTP based microservice

elb-py

Eru load balancer

openstack-lb-treeview

Displays a tree view of all loadbalancers in an OpenStack project, showing pools and members in a hierarchical structure

pymako

A Consul Client for Python.

pyalb

A simple application load balancer

pyloadbalancer

A load balancer for Python 3.5