arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.12196cs.LGstat.ML
收藏

基于几何梯度分析的神经网络不可信预测识别

Identifying Untrustworthy Predictions in Neural Networks by Geometric Gradient Analysis

Univ. of Erlangen-Nürnberg(埃尔朗根-纽伦堡大学)

Leo Schwinn, An Nguyen, René Raab, Leon Bungert, Daniel Tenbrinck, Dario Zanca, Martin Burger, Bjoern Eskofier

摘要:

深度神经网络对不可信预测的敏感性,包括分布外(OOD)数据和对抗性示例,仍然阻碍了它们在安全关键型应用中的广泛使用。大多数现有方法要么需要重新训练给定的模型,以实现对抗攻击的鲁棒识别,要么仅限于分布外样本检测。在这项工作中,我们提出了一个几何梯度分析(GGA),以提高识别不可信的预测,而无需重新训练给定的模型。GGA基于神经网络各自输入的显着图来分析其损失景观的几何形状。为了激励所提出的方法,我们提供梯度的几何性质和局部极小值的损失函数之间的理论联系。此外,我们证明了所提出的方法在检测OOD数据和对抗攻击(包括最先进的攻击和自适应攻击)方面优于以前的方法。

英文摘要:

The susceptibility of deep neural networks to untrustworthy predictions, including out-of-distribution (OOD) data and adversarial examples, still prevent their widespread use in safety-critical applications. Most existing methods either require a re-training of a given model to achieve robust identification of adversarial attacks or are limited to out-of-distribution sample detection only. In this work, we propose a geometric gradient analysis (GGA) to improve the identification of untrustworthy predictions without retraining of a given model. GGA analyzes the geometry of the loss landscape of neural networks based on the saliency maps of their respective input. To motivate the proposed approach, we provide theoretical connections between gradients' geometrical properties and local minima of the loss function. Furthermore, we demonstrate that the proposed method outperforms prior approaches in detecting OOD data and adversarial attacks, including state-of-the-art and adaptive attacks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑