Responsible Ai Python Packages

fairlearn

A Python package to assess and improve fairness of machine learning models.

raiutils

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

dalex

moDel Agnostic Language for Exploration and eXplanation

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

erroranalysis

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

responsibleai

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

raiwidgets

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

bias-detection-mcp

AI bias detection + fairness assessment MCP. Required by EU AI Act Article 10 + NYC Local Law 144. MIT

holisticai

This is an open-source tool to assess and improve the trustworthiness of AI systems.

axonflow

Official Python SDK for AxonFlow — runtime control, MCP policy enforcement, approvals, and audit trails for production AI

admina-core

The open framework for governed AI development: EU AI Act compliance, PII redaction, MCP proxy, prompt-injection firewall. Python + Rust, Apache 2.0

groundlens

Geometric LLM grounding verification — deterministic, auditable, no second LLM. Python library for measuring how faithfully model outputs reflect their sources.

trustmodel

Score any AI for trust — Eval, Monitor, Govern. 10 trust dimensions, one free API key (5 credits / $500).

jurity

[ACM 2024] Jurity: Fairness & Evaluation Library

langtest

Deliver safe & effective language models

nlptest

Deliver safe & effective language models

ethicml

Package for evaluating the performance of methods which aim to increase fairness, accountability and/or transparency

infairness

PyTorch package to train and audit ML models for Individual Fairness

admina-framework

The open framework for governed AI development: EU AI Act compliance, PII redaction, MCP proxy, prompt-injection firewall. Python + Rust, Apache 2.0

raitap

Fully integrated pipeline to assess the transparency & robustness of AI models

rhesis-sdk

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

rai-governance-platform

Open-source bias testing framework for LLMs — detect gender, racial & cultural bias in any language model via TF-IDF divergence scoring

langfair

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

llama-stack-provider-trustyai-garak

Out-Of-Tree Llama Stack Eval Provider for Red Teaming LLM Systems with Garak