ai-proxy
Lightweight AI model serving gateway with Envoy proxy and a FastAPI registry.
Drop-in LLM cost-optimization proxy. Auto-route + cache + compress + batch. Flat monthly pricing by token volume, keep 100% of savings. Free 60M tokens/mo.
Python SDK for AI Security Gateway — PII redaction, prompt injection defense, and smart routing for any LLM.
