Fairness Ai Python Packages

fairlearn

A Python package to assess and improve fairness of machine learning models.

raiutils

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

aif360

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

erroranalysis

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

responsibleai

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

raiwidgets

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

ethicml

Package for evaluating the performance of methods which aim to increase fairness, accountability and/or transparency

jurity

[ACM 2024] Jurity: Fairness & Evaluation Library

infairness

PyTorch package to train and audit ML models for Individual Fairness

rai-test-utils

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

responsibleai-vision

SDK API to assess image Machine Learning models.

langfair

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

oracle-automlx

This repository contains demo notebooks (sample code) for the AutoMLx (automated machine learning and explainability) package from Oracle Labs.

credoai-lens

Lens: comprehensive assessment framework for AI systems

nlp-feature-extractors

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

thetiscore

Service to examine data processing pipelines (e.g., machine learning or deep learning pipelines) for uncertainty consistency (calibration), fairness, and other safety-relevant aspects.

responsibleai-text

SDK API to assess text Machine Learning models.

wefe

The Word Embedding Fairness Evaluation Framework

fixout

Algorithmic inspection for trustworthy ML models

fairness-checker

AI fairness checker

thetis

Service to examine data processing pipelines (e.g., machine learning or deep learning pipelines) for uncertainty consistency (calibration), fairness, and other safety-relevant aspects.

genderbench

Evaluation suite for gender biases in LLMs.

verifyml

Open-source toolkit to help companies implement responsible AI workflows.