Local Inference Python Packages

projectdavid-platform

A single pip installed package will orchestrate a production ready instance of the AI stack in any environment

kiapi

Unified local inference API server for LLM agents on Apple Silicon (MLX).

hippo-llm

Local LLM inference + embedding & search in one package. Run 30B on consumer hardware, RAG without ChromaDB.

notolog

Notolog Markdown Editor

alcove-search

Local-first document retrieval. Your data never leaves your disk.

kiapi-relay

Unified local inference API server for LLM agents on Apple Silicon (MLX).

kiapi-proxy

Unified local inference API server for LLM agents on Apple Silicon (MLX).

mlx-serve

Local inference server for Apple Silicon that hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI-compatible API