Llm Framework Python Packages

agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

pocketflow

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

autogenstudio

A programming framework for agentic AI

ai-microcore

A handy lib for smooth interaction with large language models (LLMs) and crafting AI apps.

contextgem

ContextGem: Effortless LLM extraction from documents

model-compose

Portable AI runtime inspired by docker-compose. Compose agents, RAG pipelines, and MCP servers in one YAML file and run them anywhere.

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

abstractcore

Code once, run everywhere across Ollama, LM Studio, MLX, HuggingFace, vLLM, OpenAI, Anthropic, and more with consistent APIs for tools, structured output, streaming, media, prompt caching, and secure OpenAI-compatible gateway deployment.

tigrbl-auth

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

swarmauri-signing-jws

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

simplerllm

Simplify interactions with Large Language Models

swarmauri-signing-ed25519

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

swarmauri-signing-ecdsa

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

swarmauri-signing-rsa

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

swarmauri-signing-hmac

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

embeddedsigner

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

embedxmp

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

swarmauri-signing-dpop

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

agentmap

AgentMap: Build and deploy LangGraph workflows from CSV files. Create complex LLM agent graphs without coding, convert simple spreadsheets into powerful AI agents, and orchestrate multi-agent systems with ease. Integrates with OpenAI, Anthropic, and Google AI models. Includes CLI and FastAPI server for quick deployment.

swm-example-package

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.

acorn

LLM framework for long running agents

streamlet-py

A powerful Python framework for building declarative, concurrent data processing workflows

shyftlabs-continuum

Continuum — the agent runtime by ShyftLabs. Build, orchestrate, ship.

swm-example-community-package

Modular Python SDK and monorepo for AI agents, LLM integrations, tools, parsers, embeddings, vector stores, and extensible application workflows.