PyRank

Localai Python Packages

Python packages with the GitHub topic localai. Sorted by relevance, with stars and monthly downloads.
mraniki
myllm

A python package to interact with llm model

24K 8 1
AlexsJones
llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

22K 26K 2K
BrunoArsioli
llama-optimus

Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine

2K 33 6
djcopley
shelloracle

A terminal utility for intelligent shell command generation

1K 338 21
scouzi1966
macafm

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator

922 290 15
mkhludnev
langchain-localai

Langchain integration package with LocalAI. It provides embeddings and reranker support

548 11 0
raym33
r-cli-ai

Local AI Agent Runtime

274 14 3
EricFillion
ericchat

A Mac GUI for running LLMs locally and privately.

118 7 0
scouzi1966
maclocal-ai

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator

105 290 15
scouzi1966
maclocal

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator

79 290 15
raym33
r-cli-sdk

Python SDK for R CLI - Local AI Agent Runtime

70 14 3