semantic-routing
A high-throughput semantic routing engine for AI agents and LLM applications.
Production-grade, KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets.
SemRoute is a semantic router that helps you route using the semantic meaning of the query
