Semantic Cache Python Packages

redisvl

Redis Vector Library. The AI-native Python client for Redis.

ferrogw

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

omnicache-proxy

⚡ Zero-latency semantic caching, agent loop accelerator & cost optimization gateway for LLMs. Slash OpenAI & Anthropic bills by 40%-75%.

pion-vllm-mlx

Pion — the memory engine for AI inference

a3m-router

⚡ Adaptive multi-model LLM router — 80+ providers, Jev System One single-pass routing (model=jev-auto), pheromone-trail failover, parallel ensemble merge. npm: adaptive-memory-multi-model-router

adk-redis

Redis integration for Google Agent Development Kit (ADK) - Memory, Sessions, Search Tools, MCP

cachellm-proxy

A drop-in semantic cache for LLM APIs. One proxy routes to OpenAI, Gemini, Groq, Claude, Ollama and Bedrock. 77% hit rate, 78% lower cost, zero wrong answers on new questions.

memory-reuse

Execution cache layer for AI agents — cut LLM and tool call costs by reusing previous results.

terx

Browser-agent memory that turns repeated workflows into deterministic replays.

cachelm

Semantic caching layer for LLM apps: serves cached answers for paraphrased prompts, with pluggable vector stores and streaming support.

cacheverifier

Verification layer for semantic caches: a REST API and Python client that checks gray-zone cache hits with a cross-encoder before they are served.

llm-cache-router

Async Python library for semantic response caching, multi-provider LLM routing, and cost tracking.

fastapi-semcache

fastapi-semcache: Semantic caching for APIs & LLMs with pgvector, Redis, FastAPI middleware, and standalone proxy mode.

subconscious-mcp

Local-first semantic memory for MCP agents. Recall, remember, forget, echo, drift_report, stats over stdio.

webfetch-llm

Own your LLM's web search: a local search->fetch->rank pipeline that replaces hosted web-search tools. Measured: matches hosted accuracy at 66% lower cost and up to 88% fewer tokens, plus a precision-tuned semantic caching with query-dependant TTL that no API offers.

chorusgraph

Deterministic AI agent orchestration — comment via Discussions & Issues; code changes by maintainers only.

fow-cache

How often does your semantic cache serve the wrong answer? Benchmark, CI check and multi-turn guard.

a3m-mcp-server

⚡ Adaptive multi-model LLM router — 80+ providers, Jev System One single-pass routing (model=jev-auto), pheromone-trail failover, parallel ensemble merge. npm: adaptive-memory-multi-model-router

arcus-cli

Adaptive routing, a quality gate, and correctness-aware caching on top of Virginia Tech ARC's LLM API - local CLI, your own key, nothing leaves your machine.

agentmesh-proxy

The governance plane for AI agents — policy, budget, and audit across every framework. Istio for AI agents.

smartmemo

Semantic memory and caching for LLM agents with classifier-validated equivalence instead of naive cosine thresholds.

llm-response-cache

SQLite-backed LLM response cache. Exact match + fuzzy match. Decorator API. Zero mandatory server dependencies.

memollm

Memoize your LLM calls — 3-level cache (exact + semantic + prefix) that cuts API costs 40-70% with one line of code

recallm

Semantic cache layer for LLM APIs — embed prompts locally, find near-matches, skip redundant LLM calls.