Responsible Ai Python Packages

fairlearn

A Python package to assess and improve fairness of machine learning models.

raiutils

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

dalex

moDel Agnostic Language for Exploration and eXplanation

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

erroranalysis

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

responsibleai

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

admina-core

The open framework for governed AI development: EU AI Act compliance, PII redaction, MCP proxy, prompt-injection firewall. Python + Rust, Apache 2.0

raiwidgets

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

fairmedfm

Fairness metrics for any classification or segmentation model (pip install fairmedfm) and a fairness benchmark of medical imaging foundation models.

holisticai

This is an open-source tool to assess and improve the trustworthiness of AI systems.

axonflow

Official Python SDK for AxonFlow — runtime control, MCP policy enforcement, approvals, and audit trails for production AI

admina-framework

The open framework for governed AI development: EU AI Act compliance, PII redaction, MCP proxy, prompt-injection firewall. Python + Rust, Apache 2.0

jurity

Jurity: Fairness & Evaluation Library

langtest

Deliver safe & effective language models

ethicml

Package for evaluating the performance of methods which aim to increase fairness, accountability and/or transparency

bedrock-guardrail-firewall

Stop unsafe AI traffic before it spreads with enterprise PII redaction, prompt-injection defense, grounding checks, tamper-evident auditing, and optional Amazon Bedrock plus Presidio controls in one Python file.

infairness

PyTorch package to train and audit ML models for Individual Fairness

chap-coordinator

CHAP, the Collaborative Human Agent Protocol, is a MCP/A2A-compatible runtime for auditable human-agent work: approvals, overrides, handoffs, escalation and verifiable evidence logs.

chap-analytics

CHAP, the Collaborative Human Agent Protocol, is a MCP/A2A-compatible runtime for auditable human-agent work: approvals, overrides, handoffs, escalation and verifiable evidence logs.

bias-detection-mcp

🔌 Exposes AI bias detection + fairness assessment over MCP — Required by EU AI Act Article 10 + NYC Local Law 144. MIT

decishift

Open-source ML behavioral regression testing for comparing decision-system versions, identifying changed actions, attributing shifts, and gating releases with Decision Contracts.

ifixai

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

langfair

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

admina

The open framework for governed AI development: EU AI Act compliance, PII redaction, MCP proxy, prompt-injection firewall. Python + Rust, Apache 2.0