Counterfactual Python Packages

alibi

Algorithms for explaining machine learning models

causal-worlds

Generate fictional-but-coherent causal operations worlds (executable sim + time-series + ground-truth causal answer-key) from a natural-language description — for benchmarking causal-discovery and control agents.

decishift

Open-source ML behavioral regression testing for comparing decision-system versions, identifying changed actions, attributing shifts, and gating releases with Decision Contracts.

syntheticcontrolmethods

A Python package for causal inference using Synthetic Controls

causalrl

Causal reinforcement learning, organized around Bareinboim's 9-task taxonomy, confounded offline→online RL, POMIS, counterfactual policies, transportability, discovery, imitation, curricula.

causallift

CausalLift: Python package for causality-based Uplift Modeling in real-world business

cfnow

Easiest way to generate counterfactual explanations

bel2scm

Generate dynamic structural causal models from biological knowledge graphs encoded in the Biological Expression Language (BEL)

carla-recourse

CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms

ghostloop

The agent loop, embodied. Tool-using runtime + fail-closed safety pipeline + sim-first execution + statistically-rigorous bench harness + post-hoc analysis (counterfactual replay, causal attribution, LLM judge, property mining) for embodied AI. Sister project to GhostLM.

vlm-prior-probe

Measure when a vision-language model follows visual evidence versus learned priors.

notaryos

Cryptographic receipt system for AI agent accountability. Tamper-evident, hash-chained receipts with Ed25519/HMAC signing.

causal-agent-replay

Counterfactual replay and causal attribution over LLM-agent trajectories: find which step actually caused a failure by intervening on it.

whydunit

Find out why an LLM pipeline failed, by counterfactual replay instead of guesswork.

insurance-counterfactual-sets

Weighted conformal ITE for individual counterfactuals — Lei & Candès 2021, sensitivity analysis, FCA ENBP harm reports

fairput

FairPut - Machine Learning Fairness Framework with LightGBM — Explainability, Robustness, Fairness (by @firmai)