Localllm Python Packages

locallab

LocalLab allows you to easily run Hugging Face AI models locally or on Google Colab, featuring automatic API setup, model management, performance optimization, and system monitoring.

pyvisionai

A Python library for extracting and describing content from documents using Vision LLMs

llamashell

A powerful shell that's powered by a locally running LLM (ideally Llama 3.x or Qwen 2.5)

locallab-client

Python client for LocalLab - A local LLM server

tinyrag

TinyRag is a minimal Python library for retrieval-augmented generation. It offers easy document ingestion, automatic text extraction, embedding generation, and retrieval with vector stores. Designed for quick setup and flexible provider configuration, TinyRag enables fast, contextual responses from language models.

tiny-rag-ai

A python library that lets developers add a chat bot to any web applications with simple steps.

give-up-the-func

A library that manages tools (functions) for Local LLMs

sum-sum

A minimal CLI tool to locally summarize any text using LLM!

vulkan-ilm

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).

initialterm

Local LLM enabled Human terminal interaction made easy.