PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Local Ai Python Packages

Python packages with the GitHub topic local-ai. Sorted by relevance, with stars and monthly downloads.
Blaizzy
mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

383K 5K 539
microsoft
foundry-local-sdk

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

364K 2K 309
youssofal
mtplx

2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

16K 492 19
tanavc1
llm-autotune

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

8K 25 1
rohitgarg19
opencode-llmstack

Cursor-Auto / Claude-tier-style serving for local GGUF models on Mac (M4 Max, 64 GB). FastAPI router fronts llama-swap + llama.cpp, classifying each request into a coder, planner, or uncensored-planner tier. OpenAI-compatible API, opencode integration, per-project subshell, one `llmstack` console-script.

6K 0 0
district-solutions
oats-coder

Enables small-to-large self-hosted ai models to use local source code when running tool-calling agentic workloads. We actively data mine 20,900+ (2+ TB) popular github repos using large and small ai models to create reuseable: json, markdown and parquet files for local-first tool-calling models.

5K 2 1
lyonzin
knowledge-rag

Drop docs, search instantly from Claude Code — 12 MCP tools, 20 format parsers, hybrid search + reranking. Zero servers, zero API keys, 100% local.

5K 79 14
anzalks
loctran

local translator with OCR and AI assisted translation for images and PDFs

3K 0 0
microsoft
foundry-local-sdk-winml

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

3K 2K 309
aminoy77
hellochusquis

Terminal AI agent with multi-provider fallback, file management, code execution, and persistent memory. Supports OpenRouter, Ollama, OpenAI, Anthropic, Gemini, Groq and 15+ more providers.

3K 1 0
MRWillisT
pullnexus

Pull from the Nexus. Give back to the Nexus. Keep local AI smart.

3K 1 0
jonigl
ollama-mcp-bridge

Extend the Ollama API with dynamic AI tool integration from multiple MCP (Model Context Protocol) servers. Fully compatible, transparent, and developer-friendly, ideal for building powerful local LLM applications, AI agents, and custom chatbots

2K 86 27
inecore
evomem

Agent Memory Kit System: Capture every correction and interaction to build your own SLM from day one

2K 1 0
anandkrshnn
sovereign-ai-stack

"Local RAG with Cryptographic Verification - The Verified Airlock for Sovereign AI

2K 0 0
raphasouthall
neurostack

Your second brain, starting today. CLI + MCP server that helps you build, maintain, and search a knowledge vault that gets better every day. Works with any AI provider. Local-first, zero-prereq install.

2K 43 3
sinsniwal
hey-cli-python

Your terminal buddy that turns plain English into shell scripts — and runs them. Powered by Ollama. 100% local, 100% private.

1K 4 0
nrl-ai
edgevox

Offline voice agent framework for robots.

1K 6 0
tenseleyFlow
document-language-model

Document-first local LLM training, preference mining, retraining, and multi-target export from .dlm docs, codebases, and multimodal sources.

1K 0 0
tanaos
artifex

Small Language Model Inference, Fine-Tuning, Evaluation and Observability.

1K 92 13
mozilla-ai
encoderfile

Distribute and run transformer encoders with a single file.

988 106 16
msb-msb
mycoswarm

Distributed AI for everyone. Turn forgotten hardware into a thinking network.

944 3 2
HaseebKhalid1507
velocirag

Lightning-fast RAG for AI agents. ONNX-powered, 4-layer fusion, MCP server. No PyTorch.

924 6 1
cornelcroi
context-lens

Semantic search knowledge base for MCP-enabled AI assistants. Index local files or GitHub repos, query with natural language. Built on LanceDB vector storage. Works with Claude Desktop, Cursor, and other MCP clients.

757 22 2
3M1RY33T
tensor-serve

ZIM-based retrieval augmented proxy for OpenAI-compatible AI

727 3 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery