Local Ai Python Packages

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

foundry-local-sdk

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

mtplx

2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

llm-autotune

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

opencode-llmstack

Cursor-Auto / Claude-tier-style serving for local GGUF models on Mac (M4 Max, 64 GB). FastAPI router fronts llama-swap + llama.cpp, classifying each request into a coder, planner, or uncensored-planner tier. OpenAI-compatible API, opencode integration, per-project subshell, one `llmstack` console-script.

oats-coder

Enables small-to-large self-hosted ai models to use local source code when running tool-calling agentic workloads. We actively data mine 20,900+ (2+ TB) popular github repos using large and small ai models to create reuseable: json, markdown and parquet files for local-first tool-calling models.

knowledge-rag

Drop docs, search instantly from Claude Code — 12 MCP tools, 20 format parsers, hybrid search + reranking. Zero servers, zero API keys, 100% local.

loctran

local translator with OCR and AI assisted translation for images and PDFs

foundry-local-sdk-winml

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

hellochusquis

Terminal AI agent with multi-provider fallback, file management, code execution, and persistent memory. Supports OpenRouter, Ollama, OpenAI, Anthropic, Gemini, Groq and 15+ more providers.

pullnexus

Pull from the Nexus. Give back to the Nexus. Keep local AI smart.

ollama-mcp-bridge

Extend the Ollama API with dynamic AI tool integration from multiple MCP (Model Context Protocol) servers. Fully compatible, transparent, and developer-friendly, ideal for building powerful local LLM applications, AI agents, and custom chatbots

evomem

Agent Memory Kit System: Capture every correction and interaction to build your own SLM from day one

sovereign-ai-stack

"Local RAG with Cryptographic Verification - The Verified Airlock for Sovereign AI

neurostack

Your second brain, starting today. CLI + MCP server that helps you build, maintain, and search a knowledge vault that gets better every day. Works with any AI provider. Local-first, zero-prereq install.

hey-cli-python

Your terminal buddy that turns plain English into shell scripts — and runs them. Powered by Ollama. 100% local, 100% private.

edgevox

Offline voice agent framework for robots.

document-language-model

Document-first local LLM training, preference mining, retraining, and multi-target export from .dlm docs, codebases, and multimodal sources.

artifex

Small Language Model Inference, Fine-Tuning, Evaluation and Observability.

encoderfile

Distribute and run transformer encoders with a single file.

mycoswarm

Distributed AI for everyone. Turn forgotten hardware into a thinking network.

velocirag

Lightning-fast RAG for AI agents. ONNX-powered, 4-layer fusion, MCP server. No PyTorch.

context-lens

Semantic search knowledge base for MCP-enabled AI assistants. Index local files or GitHub repos, query with natural language. Built on LanceDB vector storage. Works with Claude Desktop, Cursor, and other MCP clients.

tensor-serve

ZIM-based retrieval augmented proxy for OpenAI-compatible AI