Localllm Python Packages

locallab

LocalLab: A lightweight AI inference server for running LLMs locally or in Google Colab with a friendly API.

augllm

Wrapper for Augmented Large Language Models

pyvisionai

The PyVisionAI Official Repo

forensia

Your local AI assistant for weekend forensic work.

llamashell

A powerful shell that's powered by a locally running LLM (ideally Llama 3.x or Qwen 2.5)

locallab-client

LocalLab allows you to easily run Hugging Face AI models locally or on Google Colab, featuring automatic API setup, model management, performance optimization, and system monitoring.

spec2llm

Find the best LLMs for your hardware specs

tinyrag

A minimal Python library for Retrieval-Augmented Generation with codebase indexing and multiple vector store backends

give-up-the-func

A helper library for using function calling on local LLMs.

tiny-rag-ai

A python library that lets developers add a chat bot to any web applications with simple steps.

vulkan-ilm

Pythonic LLM inference on legacy GPUs using Vulkan — GPU-accelerated local AI for AMD, Intel, and NVIDIA without CUDA.

sum-sum

Minimal CLI tool to summarize any text locally with help of LLM!

initialterm

Local LLM enabled Human terminal interaction made easy.