on-device-inference
Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.
⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.
Pythonic binding to the Apple Neural Engine
