Agentops Python Packages

mlflow-skinny

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

mlflow-tracing

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

zenml

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

trulens-core

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-feedback

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-otel-semconv

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-eval

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-dashboard

Evaluation and Tracking for LLM Experiments and AI Agents

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-connectors-snowflake

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-openai

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

zenml-nightly

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

trulens-providers-litellm

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-llamaindex

Evaluation and Tracking for LLM Experiments and AI Agents

cloudfall

The operator's record for self-hosted servers run by an AI agent. The agent decides, Ansible executes, Cloudfall gates every action, verifies the result and keeps the receipt. Plain Debian, no Kubernetes.

aegis-devops

Aegis: provenance-backed, authority-aware policy verifier that blocks context-poisoned and drifted AI agent actions (kubectl/terraform) before they hit infrastructure

trulens-providers-cortex

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-bedrock

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-providers-langchain

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-langgraph

Evaluation and Tracking for LLM Experiments and AI Agents

trulens-apps-nemo

Evaluation and Tracking for LLM Experiments and AI Agents