Offline Ai Python Packages

taosmd

Local-first AI memory — runs offline on any machine with 8 GB+ RAM (SBC, mini PC, laptop, workstation). Zero-loss verbatim archive, knowledge graph, hybrid retrieval. Framework-agnostic, no cloud.

lastlight

Low-power, offline retrieval (RAG) for disaster and infrastructure-failure guidance.

make-localllm-easier

One command runs the best local LLM your GPU can handle: model picked from measured multilingual benchmarks, llama.cpp tuned for AMD, NVIDIA, Intel and Apple GPUs.

ain-state-compiler

AIN State Compiler is a local-first enterprise AI state compiler that continuously transforms Slack, Jira, and Gmail logs into executable, conflict-resolved operational state. Built with Python and SQLite.

open-jet

An offline coding agent for local models. One command sets up the best model your GPU can run, and on 24 GB+ RTX 30/40/50-series cards Qwen3.8-27B runs up to 1.9x faster than llama.cpp.

thinai

Python SDK for Thinai: use LLMs running on your Android phone over local Wi-Fi

edgevox

Offline voice agent framework for robots — agents, skills, workflows, sub-second voice pipeline, 2D/3D simulation (IR-SIM + MuJoCo), 16 languages, 56 voices, ROS2-native. Runs on CPU/CUDA/Metal, no cloud.

docctl

Local-first CLI for ingesting PDFs and retrieving provenance-grounded answers with predictable machine-readable output.

repo-agent-context

local snapshot for agents of a repo's issues, PRs, CI info etc.

semantic-keywords

TF-IDF counts words. semantic-keywords understands meaning. It uses sentence embeddings (all-MiniLM-L6-v2 by default) and Maximal Marginal Relevance (MMR) to return keywords that are both relevant and diverse — not just the most frequent phrases. Works fully offline after a one-time model download. No API key. No rate limits.

pbl-lm

A real engineering language model running fully offline on an $8-class ESP32-S3 — open weights, native C, real-silicon benchmarks.

hermes-lite

Cloud-first AI agent via NVIDIA NIM Free API — rate limiting, key rotation, smart fallback chain. Local mode for offline use.

zorac

Self-hosted LLM chat client with streaming UI for vLLM servers. Run Mistral-24B locally on RTX 4090/3090. Privacy-focused ChatGPT alternative for homelab/gaming PCs. Python/Rich terminal UI.

quaynor

AI inference library for mobile devices

zai-shell

Command Line telepathy. An Autonomous Al Agent for your Terminal that turns intent into Execution (Windows/Linux/Mac)