arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.11257cs.LGcs.CV
收藏

鲁棒模型更容易解释,因为归因看起来很正常

Robust Models Are More Interpretable Because Attributions Look Normal

Pittsburgh, PA 15213, USA(美国宾夕法尼亚州匹兹堡(注:该地址不属于机构,可能是原数据错误,按要求应忽略,此处仅为示例说明))

Zifan Wang, Matt Fredrikson, Anupam Datta

摘要:

最近的研究发现,用于图像分类的对抗性强大的深度网络更具可解释性:它们的特征属性往往更清晰,并且更集中于与图像的地面实况类相关的对象。我们表明,光滑的决策边界在这种增强的可解释性中发挥了重要作用,因为当数据点光滑时,模型的输入梯度将与边界的法向量更紧密地对齐。因此,由于鲁棒模型具有更平滑的边界,因此基于梯度的归因方法(如Integrated Decisionents和DeepLift)的结果将捕获有关附近决策边界的更准确信息。这种对鲁棒可解释性的理解导致了我们的第二个贡献:\emph{boundary attributions},它聚合了关于局部决策边界的法向量的信息来解释分类结果。我们表明,通过利用支撑强大的可解释性的关键因素,边界属性产生更清晰,更集中的视觉解释-即使在非鲁棒模型。任何示例实现都可以在\url{https://github.com/zifanw/boundary}中找到。

英文摘要:

Recent work has found that adversarially-robust deep networks used for image classification are more interpretable: their feature attributions tend to be sharper, and are more concentrated on the objects associated with the image's ground-truth class. We show that smooth decision boundaries play an important role in this enhanced interpretability, as the model's input gradients around data points will more closely align with boundaries' normal vectors when they are smooth. Thus, because robust models have smoother boundaries, the results of gradient-based attribution methods, like Integrated Gradients and DeepLift, will capture more accurate information about nearby decision boundaries. This understanding of robust interpretability leads to our second contribution: \emph{boundary attributions}, which aggregate information about the normal vectors of local decision boundaries to explain a classification outcome. We show that by leveraging the key factors underpinning robust interpretability, boundary attributions produce sharper, more concentrated visual explanations -- even on non-robust models. Any example implementation can be found at \url{https://github.com/zifanw/boundary}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑