Model Cascade Python Packages

jevstiller

Distill a repeated Jev classification task into a local model, on the fly — same answers, your hardware.

taskdistill

Distil an expensive LLM API call on a narrow task into a small local model: capture traffic, curate, LoRA fine-tune with MLX on Apple Silicon, evaluate against the teacher, and serve an OpenAI-compatible cascade that escalates low-confidence requests.