Trustworthy Ai Python Packages

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

adversarial-robustness-toolbox

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

akios

AKIOS runtime for secure AI agent execution

encypher-ai

Metadata encoding and extraction for AI-generated content

proof-citations

Fetch URLs and verify that quoted text appears on the page. Extracted from proof-engine.

proof-engine-wiki

Attach verified Proof Engine proofs to LLM-wiki claims.

rhesis-sdk

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

proof-engine-registry

Proof Registry protocol: client, reference server, and static-JSON emitter.

langtest

Deliver safe & effective language models

aiverify-moonshot

AI Verify advances Gen AI testing with Project Moonshot.

detectors

Python package to accelerate research on generalized out-of-distribution (OOD) detection.

nlptest

Deliver safe & effective language models

rhesis

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

trustifai

TrustifAI: A Comprehensive Framework for AI Trustworthiness

trustllm

[ICML 2024] TrustLLM: Trustworthiness in Large Language Models

vexrag

A Red Team framework that evaluates RAG functional correctness when the retrieval backend contains poisoned passages.

aicertify

Compliance-as-code for AI systems: evaluate AI apps against EU AI Act, NIST AI RMF, and OPA/Rego policies.

trustlens

Open-source Python library for evaluating ML model reliability beyond accuracy — with calibration, failure, and fairness diagnostics for informed deployment decisions.

groundguard

Verify LLM output against your source documents. Catch hallucinations in RAG pipelines and agentic workflows before they reach users.

dqm-ml-images

Python library designed provide core dqm-ml metrics without huge dependencies, as well as common API shared by metrics

enforcecore

Lightweight runtime enforcement for agentic AI. PII masking, policy checks, and Merkle audit trails as a decorator.

markdiffusion

MarkDiffusion: An Open-Source Toolkit for Generative Watermarking of Latent Diffusion Models

dokis

Lightweight RAG provenance middleware. Verifies every claim in an LLM response is grounded in a retrieved source - without an LLM call.

dqm-ml-pytorch

Python library designed to provide core dqml domain gap metrics, as well as common API shared by metrics