Feature Attribution Python Packages

captum

Model interpretability and understanding for PyTorch

shapiq

Shapley Interactions and Shapley Values for Machine Learning

zennit

Zennit is a high-level framework in Python using PyTorch for explaining/exploring neural networks using attribution methods like LRP.

thermostat-datasets

Collection of NLP model explanations and accompanying analysis tools

cub-tools

Caltech UCSD Birds Database Tools for PyTorch Image Classification