Semantic Cache Python Packages

redisvl

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

adk-redis

Redis integration for Google Agent Development Kit (ADK) - Memory, Sessions, Search Tools, MCP

fastapi-semcache

fastapi-semcache: Semantic caching for APIs & LLMs with pgvector, Redis, FastAPI middleware, and standalone proxy mode.

agentmesh-proxy

The governance plane for AI agents — policy, budget, and audit across every framework. Istio for AI agents.

subconscious-mcp

Local-first semantic memory for MCP agents. Recall, remember, forget, echo, drift_report, stats over stdio.

khazad

Transparent, transport-layer semantic cache for LLM API calls, powered by Redis 8 Vector Sets.

lattice-memory-e8

LatticeMemory — E8 lattice semantic cache and LLM proxy. Calibrated Hamming routing, zero-false-positive intent caching, compliance mode.

smartmemo

Semantic memory for LLM agent calls with an equivalence-first cache architecture.

semanticmemo

Production-grade semantic caching for LLM agents — a learned equivalence classifier replaces the naive cosine threshold that causes false-positive failures.

toolops

ToolOps is a framework-agnostic middleware SDK that treats every tool call as a first-class operation. By wrapping your tools in a single decorator, you instantly upgrade them with industrial-grade caching, resilience, and observability.

omnicache-ai

Unified multi-layer caching library for AI/agent pipelines — LangChain, LangGraph, AutoGen, CrewAI, Agno, A2A

aurekai

Aurekai is the operating fabric for intelligent work: Akai runtime, model memory, proof, semantic cache, and integrations for AI-native operations.

recallm

Semantic caching for LLMs. Ask once, recall forever.

memollm

3-level LLM cache (exact, semantic, prefix) with real-time token cost tracking

llm-response-cache

SQLite-backed LLM response cache. Exact match + fuzzy match. Decorator API. Zero mandatory server dependencies.

certainlogic-guard

Deterministic AI verification middleware that catches hallucinations and cuts token costs.