semantic-caching
Semantic memory for LLM agent calls with an equivalence-first cache architecture.
Intelligent LLM agent cost optimization runtime — per-run budget enforcement, semantic caching, model routing across 15 providers
The official Python SDK for the Hyperion AI Gateway
A Python library for the Semcache API