Bias Detection Python Packages

aif360

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

dataeval

Python library for analyzing data quality and its impact on model performance across classification and object-detection tasks.

dataeval-plots

Python library for analyzing data quality and its impact on model performance across classification and object-detection tasks.

fairmedfm

Fairness metrics for any classification or segmentation model (pip install fairmedfm) and a fairness benchmark of medical imaging foundation models.

jurity

Jurity: Fairness & Evaluation Library

bias-detection-mcp

🔌 Exposes AI bias detection + fairness assessment over MCP — Required by EU AI Act Article 10 + NYC Local Law 144. MIT

langfair

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

juryrig

Audit LLM judges before you trust them — position/verbosity bias, agreement matrix, panels, calibration. Zero dependencies. PyPI: juryrig.

fairsense-agentix

An agentic fairness and AI-risk analysis platform: bias detection for text, images, and datasets.

valiron

Generate regulatory-grade AI validation evidence in minutes, not months.

model-diagnostics

Tools for diagnostics and assessment of (machine learning) models

ai-safety-tester

LLM Security Testing Framework | CVE-style severity scoring, prompt injection detection, bias analysis | Strict mypy typing | Fast CI/CD with pytest markers | PyPI: ai-safety-tester

optipfair

Structured pruning, knowledge distillation, and fairness analysis for Large Language Models.

daml

Python library for analyzing data quality and its impact on model performance across classification and object-detection tasks.

wefe

WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

oversampleqa

A question-answering project focused on handling imbalanced datasets through advanced oversampling techniques.

eticas-audit

An open-source Python library designed for developers to calculate fairness metrics and assess bias in machine learning models.

unbias-plus

Python package that finds biased language in text, explains why, suggests neutral wording, and rewrites the whole text. Use from CLI, API, or Python.

avs-framework

Open-source statistical engine for auditing AI employment decision systems: adverse impact analysis under the Uniform Guidelines (29 CFR 1607), name-swap bias testing, and model drift detection

zeropointlogic

TypeScript and Python SDKs for the ZPL stability engine — AIN bias detection across finance, gaming, AI/ML, security and crypto. Includes an OpenAPI 3.0 spec on GitHub Pages, a Postman collection, a GitHub Action template and a Unity guide.

trustlens

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

ai-fairness-toolkit

AI Fairness and Explainability Toolkit (AFET) is an open-source project aimed at providing tools and frameworks to assess, visualize, and mitigate bias in machine learning models. It supports multiple ML frameworks and offers a comprehensive suite of metrics and visualization components to enhance model transparency and fairness.

n2e

This repository contains name-to-ethnicity classifier 'n2e' available on PyPI.

judgekit

Bias probes for LLM judges, each with a bootstrap confidence interval: position, verbosity, self-preference, calibration and stability — qwen2.5:14b picks whichever answer is shown first 77% of the time.