Fairness Testing Python Packages

aif360

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

langfair

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

aequitas-lite

Bias Auditing & Fair ML Toolkit

indoctrine-ai

The Open-Source Framework for Agentic Ethics, AI Agent Values, and Safety Compliance (NIST, EU AI Act)

bias-rv

A package to generate biased mutants for texts

aif360-fork2

IBM AI Fairness 360