Llmops Python Packages

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

mlflow-skinny

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow-tracing

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

openinference-semantic-conventions

OpenTelemetry Instrumentation for AI Observability

openinference-instrumentation

OpenTelemetry Instrumentation for AI Observability

litellm-proxy-extras

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

litellm-enterprise

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

portkey-ai

Build reliable, secure, and production-ready AI apps easily.

opentelemetry-instrumentation-anthropic

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-langchain

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-openai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-vertexai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

openinference-instrumentation-langchain

OpenTelemetry Instrumentation for AI Observability

openinference-instrumentation-openai

OpenTelemetry Instrumentation for AI Observability

opentelemetry-instrumentation-google-generativeai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-bedrock

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-crewai

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-qdrant

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-cohere

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-llamaindex

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-ollama

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-transformers

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

opentelemetry-instrumentation-replicate

Open-source observability for your GenAI or LLM application, based on OpenTelemetry