Localllm Python Packages

whichllm

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

vaf

文 Veyllo Agentic Framework

locallab

LocalLab allows you to easily run Hugging Face AI models locally or on Google Colab, featuring automatic API setup, model management, performance optimization, and system monitoring.

codefinetuner

Create your own local code autocomplete model, fine-tuned on your custom code repository, for use in editors like VS Code or Neovim.

augllm

Wrapper for Augmented Large Language Models

pyvisionai

The PyVisionAI Official Repo

locallab-client

LocalLab allows you to easily run Hugging Face AI models locally or on Google Colab, featuring automatic API setup, model management, performance optimization, and system monitoring.

spec2llm

Find the best LLMs for your hardware specs

llamashell

A powerful shell that's powered by a locally running LLM (ideally Llama 3.x or Qwen 2.5)

forensia

Your local AI assistant for weekend forensic work.

give-up-the-func

A library that manages tools (functions) for Local LLMs

tinyrag

TinyRag is a minimal Python library for retrieval-augmented generation. It offers easy document ingestion, automatic text extraction, embedding generation, and retrieval with vector stores. Designed for quick setup and flexible provider configuration, TinyRag enables fast, contextual responses from language models.

tiny-rag-ai

A python library that lets developers add a chat bot to any web applications with simple steps.

sum-sum

A minimal CLI tool to locally summarize any text using LLM!

vulkan-ilm

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).

initialterm

Local LLM enabled Human terminal interaction made easy.