Evaluations Python Packages

railtracks

An agentic framework that helps developers build resilient agentic systems

ecp-runtime

ECP is a standardized interface for orchestrating, auditing, and enforcing authority limits in AI Agent evaluations. It moves evaluation from "brittle Python scripts" to a deterministic infrastructure protocol

ecp-sdk

ECP is a standardized interface for orchestrating, auditing, and enforcing authority limits in AI Agent evaluations. It moves evaluation from "brittle Python scripts" to a deterministic infrastructure protocol

evaluations

This library implements various metrics (including Kaggle Competition, Medicine) for evaluating ML, DL, AI models, and algorithms. 📐📊📈📉📏

log10-io

Unified LLM data management

apolien

AI Safety Evaluation Library

railtracks-cli

An agentic framework that helps developers build resilient agentic systems

evret

Evals framework for Information Retrieval Systems

mandoline

Official Python client for the Mandoline API

aniket-agentlens-sdk

Python tracing SDK for AgentLens, an open-source observability platform for AI agents.