PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Llm Python Packages

Python packages with the GitHub topic llm. Sorted by relevance, with stars and monthly downloads.
BerriAI
litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

464.4M 48K 8K
sgl-project
sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

303.2M 28K 6K
langchain-ai
langchain

The agent engineering platform.

253.3M 137K 23K
pydantic
pydantic-ai-slim

AI Agent Framework, the Pydantic way

223.2M 17K 2K
huggingface
transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

149.1M 161K 33K
pydantic
pydantic-graph

AI Agent Framework, the Pydantic way

131.7M 17K 2K
huggingface
datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

127.8M 22K 3K
langchain-ai
langchain-core

The agent engineering platform.

111.6M 137K 23K
langchain-ai
langchain-openai

The agent engineering platform.

70.9M 137K 23K
ray-project
ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

56.1M 43K 8K
langchain-ai
langgraph

Build resilient agents.

52.9M 32K 5K
langchain-ai
langgraph-prebuilt

Build resilient agents.

45.8M 32K 5K
langchain-ai
langchain-text-splitters

The agent engineering platform.

43.9M 137K 23K
langchain-ai
langgraph-checkpoint

Build resilient agents.

42.8M 32K 5K
pydantic
pydantic-ai

AI Agent Framework, the Pydantic way

41.5M 17K 2K
langchain-ai
langgraph-sdk

Build resilient agents.

41.2M 32K 5K
openai
openai-agents

A lightweight, powerful framework for multi-agent workflows

32.6M 26K 4K
pydantic
pydantic-evals

AI Agent Framework, the Pydantic way

30.4M 17K 2K
langchain-ai
langchain-google-vertexai

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

25.1M 379 433
mangiucugna
json-repair

Repair malformed JSON from LLMs, APIs, logs, and user input in Python.

23.3M 5K 195
langchain-ai
langchain-anthropic

The agent engineering platform.

19.1M 137K 23K
langchain-ai
langchain-classic

The agent engineering platform.

18.4M 137K 23K
langchain-ai
langchain-google-genai

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

14.8M 379 433
tadata-org
fastapi-mcp

Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!

14.7M 12K 944
    • Data from PyPI, GitHub, ClickHouse, and BigQuery