Localai Python Packages

llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

myllm

A python package to interact with llm model

llama-optimus

llama-optimus is a lightweight Python tool to automatically optimize llama.cpp performance flags for maximum tg & pp token/s throughput. Powered by Bayesian optimization with Optuna

macafm

Access Apple's on-device Foundation Models via CLI and OpenAI-compatible API

langchain-localai

Langchain integration package with LocalAI. It provides embeddings and reranker support

shelloracle

A terminal utility for intelligent shell command generation

screenmind

AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by Gemma 4 . 100% local, 100% private.

r-cli-ai

Local AI Agent Runtime

ericchat

A Mac GUI for running LLMs locally and privately.

maclocal-ai

Local LLM inference on Apple Silicon

maclocal

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator

r-cli-sdk

Python SDK for R CLI - Local AI Agent Runtime