integrated-gradients
DeepLIFT (Deep Learning Important FeaTures)
SyReNN: Symbolic Representations for Neural Networks