Llm Python Packages

litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

langchain

The agent engineering platform.

pydantic-ai-slim

AI Agent Framework, the Pydantic way

browser-use

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

langchain-core

The agent engineering platform.

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

pydantic-graph

AI Agent Framework, the Pydantic way

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

langchain-openai

The agent engineering platform.

langgraph

Build resilient agents.

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

langgraph-prebuilt

Build resilient agents.

langgraph-sdk

Build resilient agents.

langgraph-checkpoint

Build resilient agents.

langchain-text-splitters

The agent engineering platform.

json-repair

Repair malformed JSON from LLMs, APIs, logs, and user input in Python.

strands-agents

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

langchain-google-vertexai

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

openai-agents

A lightweight, powerful framework for multi-agent workflows

agent-client-protocol

Python SDK for ACP clients and agents.

fastapi-mcp

Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!

pydantic-ai

AI Agent Framework, the Pydantic way

langchain-anthropic

The agent engineering platform.