Load Balancer Python Packages

huddle-cluster

High-performance distributed load balancer.

airflow-balancer

Utilities for tracking hosts and ports and load balancing DAGs

ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

sollol

Intelligent Load Balancer for Ollama Clusters - Adaptive Parallelism + VRAM-Aware GPU Routing + Ray/Dask/llama.cpp Distribution

nya-proxy

NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI tools (like OpenAI, Gemini, Anthropic), image generators, or almost any web service that uses access keys. It helps you use these services more reliably, efficiently, and securely.

paddler-client

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

f5-openstack-lbaasv2-driver

F5 LBaaSv2 service provider driver for OpenStack Liberty and beyond

openai-priority-loadbalancer

A multi-backend, prioritization load balancer for OpenAI

berserker-resolver

Fast mass dns resolver

openstack-lb-treeview

Display a tree view of OpenStack loadbalancers, pools, and members

elb-py

Eru load balancer

pymako

A Consul Client for Python.

sharkradar

Lightweight micro service registry and discovery tool, compatible with any HTTP based microservice

pyalb

A load balancer implementation from scratch in python

pyloadbalancer

A load balancer for Python 3.5