Trustworthy Ai Python Packages

adversarial-robustness-toolbox

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

giskard

🐢 Open-Source Evaluation & Testing library for LLM Agents

groundlens

GroundLens is an execution verification runtime for AI systems and agents. It turns observable AI execution into deterministic, policy-governed evidence that can be independently verified.

langtest

Deliver safe & effective language models

akios

AKIOS runtime for secure AI agent execution

trustworthy-stock-intelligence

A research-oriented framework for explainable and uncertainty-aware stock risk early-warning.

enforcecore

The runtime enforcement layer for agentic AI systems.

aiverify-moonshot

Moonshot - A simple and modular tool to evaluate and red-team any LLM application.

dqm-ml-core

A library to compute data quality metrics

dqm-ml-images

A library to compute data quality metrics

dqm-ml

A library to compute data quality metrics

dqm-ml-pipeline

A library to compute data quality metrics

agentweave-router

Pre-inference tool and agent routing for MCP, A2A and tool-rich LLM systems. Reduce candidate tools before model inference with policy-aware routing and recovery.

encypher-ai

Metadata encoding and extraction for AI-generated content

dro

A package of distributionally robust optimization (DRO) methods. Implemented via cvxpy and PyTorch

nlptest

Deliver safe & effective language models

reasonsmith

Prove which legally-owed reasons a decision system deleted, and from whom — by re-running its own inference, not reading its log. Every verdict states how it was reached.

markdiffusion

[JMLR] MarkDiffusion: An Open-Source Toolkit for Generative Watermarking of Latent Diffusion Models

quantumuq

Uncertainty quantification, calibration, and reliability benchmarking for quantum machine learning with Qiskit and PennyLane.

helix-adapter

Portable constitutional adapter for any LLM. Forces epistemic markers ([FACT], [REASONED], etc.), real-time drift detection, and tamper-evident receipts. Model-agnostic wrapper.

auditable

Audit any agent decision across its past, present, and future, on one typed graph.

trustllm

[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

fixout

Algorithmic inspection for trustworthy ML models

markllm

[EMNLP 2024 Demo] MarkLLM: An Open-Source Toolkit for LLM Watermarking