Early Exit Python Packages

tachyroute

The blazing-fast, multimodal AI decision engine. Uses adaptive early-exit computing and attention rollout for sub-15ms explainable zero-shot classification

earlyon

Deployment-oriented early-exit toolkit for PyTorch vision models, with per-head calibration, fair benchmarks, and staged inference.

tide-inference

Dynamic per-token early exit for LLM inference. Skip layers tokens don't need