Llm Python Packages

litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

langchain

The agent engineering platform.

pydantic-ai-slim

AI Agent Framework, the Pydantic way

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

pydantic-graph

AI Agent Framework, the Pydantic way

datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

langchain-core

The agent engineering platform.

langchain-openai

The agent engineering platform.

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

langgraph

Build resilient agents.

langgraph-prebuilt

Build resilient agents.

langchain-text-splitters

The agent engineering platform.

langgraph-checkpoint

Build resilient agents.

pydantic-ai

AI Agent Framework, the Pydantic way

langgraph-sdk

Build resilient agents.

openai-agents

A lightweight, powerful framework for multi-agent workflows

pydantic-evals

AI Agent Framework, the Pydantic way

langchain-google-vertexai

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

json-repair

Repair malformed JSON from LLMs, APIs, logs, and user input in Python.

langchain-anthropic

The agent engineering platform.

langchain-classic

The agent engineering platform.

langchain-google-genai

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

fastapi-mcp

Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!