gptcache
Verification layer for semantic caches: a REST API and Python client that checks gray-zone cache hits with a cross-encoder before they are served.
How often does your semantic cache serve the wrong answer? Benchmark, CI check and multi-turn guard.