embedded-ml
Ahead-of-time compiler that fits ML models on embedded devices with hard memory budgets.
Compress PyTorch models for edge devices — CPU-only, no GPU, no retraining. One function call.
Static INT8 AOT compiler that turns fixed PyTorch MCU models into standalone C11
Pure-Rust prompt-injection detector with 1.5MB embedded MLP classifier. 98.40% accuracy, p50 14ms CPU inference, bindings for Python/JS/Go. Apache-2.0/MIT alternative to Rebuff (archived) and Lakera Guard.
Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai
