text-generation-webui
Unified interface for AI providers with caching, rate limiting, and type safety