Edge Ai Python Packages

litert-lm-builder

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

abstractintegratedmodule

[~] IntegratedPipeline is a standalone AI Agent Library for Non-LLM memory Augmented Agentic Framework, Specifically designed to provide Agentic capability for any Autonomous Agentic Framework locally and Coordinatively that runs efficiently on small embedded systems to High end embedded systems, While continuously learning and runs efficiently.

tigris-ml

Ahead-of-time compiler that fits ML models on embedded devices with hard memory budgets.

litert-lm-api

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

taosmd

Local-first AI memory — runs offline on any machine with 8 GB+ RAM (SBC, mini PC, laptop, workstation). Zero-loss verbatim archive, knowledge graph, hybrid retrieval. Framework-agnostic, no cloud.

litert-lm-api-nightly

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

litert-lm

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

shad0wllm

System 0 for your LLM: learns the fixed-choice answers your LLM gives (intents, routing, moderation) and serves the repeats in microseconds from a small CPU table, at most 5% disagreement, certified. Zero-code proxy for the OpenAI Decisions API, System One and chat models.

llama-roofline

Is your llama.cpp decode memory-bandwidth-bound? Find out in one command.

ameva-runtime

Unified Next-Gen Hardware Orchestration & AI Acceleration Runtime for Mobile & Edge

termux-diffusion

AmfyUI (ComfyUI Mobile DAG Studio) & Z-Image Turbo (6.0B DiT) On-Device Diffusion Runtime for Android Termux

mblt-model-zoo

Mobilint Model Zoo Project

maixpy

Easily create AI projects with Python on edge device

cuvis-ai

Cuvis.AI is an open-source, extensible framework for building modular AI pipelines that process, analyze, and deploy hyperspectral video data in real-time applications.

libreyolo

LibreYOLO is a MIT licensed open source computer vision library

litert-lm-builder-nightly

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

termux-llamacpp

Production-grade, prebuilt GGUF LLM runtime, model manager & OpenAI-compatible server for Android Termux & ARM64.

litert-lm-nightly

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

mblt-vision-python

Python toolkit for preprocessing, inference, and postprocessing of computer vision models on Mobilint NPUs and ONNX Runtime.

easydetect

Real-time object detection you can ship — Easydetect with PyTorch training, OpenVINO inference, and a browser app. Apache-2.0.

pytorchwildlife

Microsoft AI for Good Lab — Biodiversity research hub. Open-source AI models, edge devices, and tools for biodiversity monitoring and conservation. Your source for MegaDetector, SPARROW, PytorchWildlife, Bioacoustics, and more.

termux-vision

🚀 The Sovereign On-Device Computer Vision & Multimodal VLM Inference Engine for Android Termux & ARM64 (Dual-Engine Python & Node.js/TypeScript)

edgejev

离线可用的本地类型化决策：4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev

ollama-herd

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.