Local Ai Python Packages

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

foundry-local-sdk

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

imap-cleanup-tool

Bulk-delete or move IMAP emails by AI Cleanup (NEW), sender, domain, or nested rules - CLI + Web GUI, stdlib-only Python. Gmail support, scheduling. Windows/Linux/MacOS supported platforms.

lilbee

A local AI search engine: it runs and manages local AI models, searches your files and code, and crawls the web, all in one program. Cited answers, local-first, with an MCP server for your coding agent. TUI, CLI, REST API, and Python library. Works with Ollama and LM Studio.

ltcai

Local-first private AI memory layer / Digital Brain for conversations, documents, decisions, and model-agnostic knowledge.

squish-ai

⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.

knowledge-rag

Local RAG MCP server for Claude Code — hybrid search (semantic + BM25), cross-encoder reranking, 13 MCP tools, 20 format parsers. Zero external servers, zero API keys.

mtplx

2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

shardstitch

Recover and hand off your AI coding session — after a rate limit, crash, or context bloat — across 23 tools. 100% local, no cloud, no account.

hermes-router

Local AI control center and routing/control plane for OpenAI-compatible agents, local runtimes, receipts, telemetry, and safety policy.

alfard

Run AI agents on your machine. Each agent has persistent memory, connects to your real tools, and talks to you from terminal, Telegram, Discord or Slack simultaneously. Nothing acts without your approval. Nothing leaves your machine.

kontinuum-core

Neuro-inspirierte Lern-Engine (HA-agnostisch). Core von KONTINUUM.

skillware

A Python framework for modular, self-contained skill management for machines.

zettabrain-rag

Private AI document assistant — chat with your documents using a fully local RAG pipeline. No API keys, no cloud, no data leaving your machine.

llm-autotune

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

foundry-local-sdk-winml

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

ollama-mcp-bridge

Extend the Ollama API with dynamic AI tool integration from multiple MCP (Model Context Protocol) servers. Fully compatible, transparent, and developer-friendly, ideal for building powerful local LLM applications, AI agents, and custom chatbots

opencode-llmstack

Cursor-Auto / Claude-tier-style serving for local GGUF models on Mac (M4 Max, 64 GB). FastAPI router fronts llama-swap + llama.cpp, classifying each request into a coder, planner, or uncensored-planner tier. OpenAI-compatible API, opencode integration, per-project subshell, one `llmstack` console-script.

encoderfile

Distribute and run transformer encoders with a single file.

whisper-local

Free, open-source, 100% offline AI dictation for Windows & macOS. Wispr Flow / Dragon alternative. Push-to-talk hotkey, voice commands, transforms, sub-second latency. Powered by Whisper. No cloud, no subscription, no telemetry.

areno

An easy-to-use, fast toolkit to scale up RL post-training on a single node.

neurostack

Your second brain, starting today. CLI + MCP server that helps you build, maintain, and search a knowledge vault that gets better every day. Works with any AI provider. Local-first, zero-prereq install.

ghosttest

An autonomous local-first AI Agent that generates, runs, and self-heals Python unit tests in real-time. Supports Ollama, Groq, and many frameworks such as pytest.

echoalign-asr-mlx

Local Apple Silicon CLI for ASR, subtitles, WebVTT/SRT, and timestamp-aligned JSON with MLX + Qwen3