PEREGRiNN:惩罚松弛贪婪神经网络验证器
PEREGRiNN: Penalized-Relaxation Greedy Neural Network Verifier
摘要:
神经网络(NN)具有与其在现实世界应用中的扩散相称的日益明显的安全性影响:意外的以及对抗性的错误分类都可能导致致命的结果。因此,形式化验证技术已被公认为是设计和部署安全神经网络的关键。在本文中,我们介绍了一种新的方法来正式验证ReLU NN最常见的安全规范-即网络输入和输出的多面体规范。像其他一些方法一样,我们使用一个放松的凸规划来减轻问题的组合复杂性。然而,我们的方法的独特之处在于,我们不仅使用凸解算器作为线性可行性检查器,而且还作为惩罚解决方案中允许的松弛量的手段。特别地,我们通过通常的线性约束对每个ReLU进行编码,并将其与凸目标函数相结合,该凸目标函数对每个神经元的输出与其松弛之间的差异进行惩罚。该凸函数进一步构造成迫使最大弛豫出现在最接近输入层的地方;这提供了进一步的好处,即当逐层调节时,尽可能早地调节最有问题的神经元。可以利用这种范例来创建一种验证算法,该算法不仅在一般情况下比竞争方法更快,而且还能够验证更多的安全属性;我们在标准MNIST鲁棒性验证套件上评估了PEREGRiNN,以证实这些声明。
英文摘要:
Neural Networks (NNs) have increasingly apparent safety implications commensurate with their proliferation in real-world applications: both unanticipated as well as adversarial misclassifications can result in fatal outcomes. As a consequence, techniques of formal verification have been recognized as crucial to the design and deployment of safe NNs. In this paper, we introduce a new approach to formally verify the most commonly considered safety specifications for ReLU NNs -- i.e. polytopic specifications on the input and output of the network. Like some other approaches, ours uses a relaxed convex program to mitigate the combinatorial complexity of the problem. However, unique in our approach is the way we use a convex solver not only as a linear feasibility checker, but also as a means of penalizing the amount of relaxation allowed in solutions. In particular, we encode each ReLU by means of the usual linear constraints, and combine this with a convex objective function that penalizes the discrepancy between the output of each neuron and its relaxation. This convex function is further structured to force the largest relaxations to appear closest to the input layer; this provides the further benefit that the most problematic neurons are conditioned as early as possible, when conditioning layer by layer. This paradigm can be leveraged to create a verification algorithm that is not only faster in general than competing approaches, but is also able to verify considerably more safety properties; we evaluated PEREGRiNN on a standard MNIST robustness verification suite to substantiate these claims.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。