MoreauGrad:基于Moreau包络的神经网络稀疏鲁棒解释
MoreauGrad: Sparse and Robust Interpretation of Neural Networks via Moreau Envelope
摘要:
解释深度神经网络的预测一直是计算机视觉文献中非常感兴趣的话题。虽然已经提出了几种基于梯度的解释方案来揭示神经网络预测中的影响变量,但通常观察到标准的基于梯度的解释框架缺乏对输入扰动的鲁棒性和结合稀疏性和组稀疏性结构的先验知识的灵活性。在这项工作中,我们提出MoreauGrad作为分类器神经网络的Moreau包络的基础上的解释方案。我们表明,MoreauGrad结果在一个光滑和强大的解释多层神经网络,可以有效地计算通过一阶优化方法。此外,我们表明MoreauGrad可以自然地与$L_1$范数正则化技术相结合,以输出稀疏或组稀疏解释,这些解释是适用于广泛的深度学习应用的先验条件。我们经验评估建议MoreauGrad计划的标准计算机视觉数据集,显示定性和定量的成功MoreauGrad方法相比,标准的基于梯度的解释方法。
英文摘要:
Explaining the predictions of deep neural nets has been a topic of great interest in the computer vision literature. While several gradient-based interpretation schemes have been proposed to reveal the influential variables in a neural net's prediction, standard gradient-based interpretation frameworks have been commonly observed to lack robustness to input perturbations and flexibility for incorporating prior knowledge of sparsity and group-sparsity structures. In this work, we propose MoreauGrad as an interpretation scheme based on the classifier neural net's Moreau envelope. We demonstrate that MoreauGrad results in a smooth and robust interpretation of a multi-layer neural network and can be efficiently computed through first-order optimization methods. Furthermore, we show that MoreauGrad can be naturally combined with $L_1$-norm regularization techniques to output a sparse or group-sparse explanation which are prior conditions applicable to a wide range of deep learning applications. We empirically evaluate the proposed MoreauGrad scheme on standard computer vision datasets, showing the qualitative and quantitative success of the MoreauGrad approach in comparison to standard gradient-based interpretation methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。