Localai Python Packages

llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

myllm

A python package to interact with llm model

llama-optimus

Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine

macafm

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator

langchain-localai

Langchain integration package with LocalAI. It provides embeddings and reranker support

shelloracle

A terminal utility for intelligent shell command generation

screenmind

AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by Gemma 4 . 100% local, 100% private.

r-cli-ai

Local AI Agent Runtime

ericchat

A Mac GUI for running LLMs locally and privately.

maclocal-ai

Local LLM inference on Apple Silicon

maclocal

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator

r-cli-sdk

Python SDK for R CLI - Local AI Agent Runtime