基于最小不确定性的深度神经网络攻击检测
Minimum Uncertainty Based Detection of Adversaries in Deep Neural Networks
摘要:
尽管它们在各个领域具有前所未有的性能,但在安全关键环境中使用深度神经网络(DNN)在即使是小的对抗性扰动的情况下也受到严重限制。目前的工作开发了一种基于最小不确定性度量的随机方法来检测这种扰动,该度量依赖于DNN推理阶段隐藏层的采样。受不确定性估计的贝叶斯方法的启发,设计了采样概率以有效地检测不利损坏的输入。由于是模块化的,这种新型的对手检测器可以方便地被任何预先训练的DNN使用,而不需要额外的训练开销。选择每个隐藏层采样的单元需要量化DNN输出不确定性的数量,其中整体不确定性以其逐层分量表示-这也促进了可扩展性。然后,通过逐层最小化不确定性措施来寻求采样概率,从而导致一个新的凸优化问题,该问题允许具有超线性收敛速度的精确求解器。通过简化目标函数,低复杂度的近似求解器也被开发。除了有价值的见解,这些近似将新方法与最先进的随机对抗检测器联系起来。通过对不同强度水平的各种类型的对抗攻击进行广泛的测试,突出了在竞争替代品的背景下,新型检测器的有效性。
英文摘要:
Despite their unprecedented performance in various domains, utilization of Deep Neural Networks (DNNs) in safety-critical environments is severely limited in the presence of even small adversarial perturbations. The present work develops a randomized approach to detecting such perturbations based on minimum uncertainty metrics that rely on sampling at the hidden layers during the DNN inference stage. Inspired by Bayesian approaches to uncertainty estimation, the sampling probabilities are designed for effective detection of the adversarially corrupted inputs. Being modular, the novel detector of adversaries can be conveniently employed by any pre-trained DNN at no extra training overhead. Selecting which units to sample per hidden layer entails quantifying the amount of DNN output uncertainty, where the overall uncertainty is expressed in terms of its layer-wise components - what also promotes scalability. Sampling probabilities are then sought by minimizing uncertainty measures layer-by-layer, leading to a novel convex optimization problem that admits an exact solver with superlinear convergence rate. By simplifying the objective function, low-complexity approximate solvers are also developed. In addition to valuable insights, these approximations link the novel approach with state-of-the-art randomized adversarial detectors. The effectiveness of the novel detectors in the context of competing alternatives is highlighted through extensive tests for various types of adversarial attacks with variable levels of strength.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。