Llm Framework Python Packages

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

ai-microcore

A handy lib for smooth interaction with large language models (LLMs) and crafting AI apps.

abstractcore

Code once, run everywhere across Ollama, LM Studio, MLX, HuggingFace, vLLM, OpenAI, Anthropic, and more with consistent APIs for tools, structured output, streaming, media, prompt caching, and secure OpenAI-compatible gateway deployment.

autogenstudio

A programming framework for agentic AI

contextgem

ContextGem: Effortless LLM extraction from documents

shyftlabs-continuum

Continuum — the agent runtime by ShyftLabs. Build, orchestrate, ship.

promptise

The foundation layer for agentic intelligence.

simplerllm

Python library for building with LLMs. One interface across 11 providers (OpenAI, Anthropic, Gemini, DeepSeek, Ollama and more), automatic failover, Pydantic-validated structured output, embeddings with vector search, and an AI-powered router. pip install simplerllm

agentmap

AgentMap: Build and deploy LangGraph workflows from CSV files. Create complex LLM agent graphs without coding, convert simple spreadsheets into powerful AI agents, and orchestrate multi-agent systems with ease. Integrates with OpenAI, Anthropic, and Google AI models. Includes CLI and FastAPI server for quick deployment.

swarmauri-community

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

unstract-sdk

A framework for writing Unstract Tools/Apps

agent-harnesses-mcp

🏆 Ranked list of 167 AI agent harnesses, plus templates, playbooks, MCP, and learning resources. Rescored weekly.

aqven-llm

Python framework + local Studio for reliable LLM workflows: typed files in your repo, pre-run checks, experiments and evals, MCP server for coding agents

acorn

LLM framework for long running agents

swm-example-package

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

aqven

Python framework + local Studio for reliable LLM workflows: typed files in your repo, pre-run checks, experiments and evals, MCP server for coding agents

swm-example-community-package

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

embeddedsigner

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

embedxmp

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

mediasigner

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

vrraj-llm-adapter

Provider-agnostic LLM adapter supporting OpenAI, Gemini, and NVIDIA NIM. Custom model registries, inference routing, embeddings, normalized outputs, and an interactive testing playground.

synapsekit

Minimal, async-first Python framework for production LLM apps- 2 hard deps, no magic, no SaaS.