guided-backpropagation
DeepLIFT (Deep Learning Important FeaTures)
📦 Flexible visualization package for generatinglayer-wise explanations for CNNs.