arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.08824cs.LG
收藏

LEVIS:面向神经网络的大型精确可验证输入空间

LEVIS: Large Exact Verifiable Input Spaces for Neural Networks

Mohamad Fares El Hajj Chehade, Wenting Li, Brian W. Bell, Russell Bent, Saif R. Kazi, Hao Zhu

AI总结:

LEVIS框架通过LEVIS-α和LEVIS-β识别并刻画大型精确可验证输入空间,结合MIP与互补约束优化实现最高6倍加速,并在电力潮流回归和图像分类中验证了有效性。

摘要:

神经网络的鲁棒性在安全关键应用中至关重要,其中识别可靠的输入空间对于有效的模型选择、鲁棒性评估以及可靠控制策略的开发必不可少。现有的大多数鲁棒性验证方法在假设输入空间已知的前提下评估最坏情况输出。然而,由于输入空间可能存在高维性、不连续性和非凸性,精确识别一个不存在对抗样本的可验证输入空间 \\(\mathcal{C}\\) 具有挑战性。为应对这一挑战,我们提出了一个新颖的框架 **LEVIS**,该框架由 **LEVIS-α** 和 **LEVIS-β** 组成。**LEVIS-α** 识别一个单一的大型可验证球,该球与有界区域 \\(\mathcal{C}\\) 的至少两个边界相交,而 **LEVIS-β** 通过整合多个可验证球系统地刻画整个可验证空间。我们的贡献包括:(1) 引入一个验证框架,利用混合整数规划(MIP)计算最近对抗点和方向对抗点;(2) 将互补约束(CC)优化与简化后的 MIP 公式相结合以提升可扩展性,实现了高达 6 倍的运行时间缩减;(3) 从理论上刻画了 **LEVIS-α** 所获得的可验证球的性质;(4) 在电力潮流回归和图像分类等应用中验证了该方法,展示了性能提升以及对可验证区域的几何洞察。

英文摘要:

The robustness of neural networks is crucial in safety-critical applications, where identifying a reliable input space is essential for effective model selection, robustness evaluation, and the development of reliable control strategies. Most existing robustness verification methods assess the worst-case output under the assumption that the input space is known. However, precisely identifying a verifiable input space \(\mathcal{C}\), where no adversarial examples exist, is challenging due to the possible high dimensionality, discontinuity, and non-convex nature of the input space. To address this challenge, we propose a novel framework, **LEVIS**, consisting of **LEVIS-α** and **LEVIS-\b{eta}**. **LEVIS-α** identifies a single, large verifiable ball that intersects at least two boundaries of a bounded region \(\mathcal{C}\), while **LEVIS-\b{eta}** systematically captures the entirety of the verifiable space by integrating multiple verifiable balls. Our contributions include: (1) introducing a verification framework that uses mixed-integer programming (MIP) to compute nearest and directional adversarial points, (2) integrating complementarity-constrained (CC) optimization with a reduced MIP formulation for scalability, achieving up to a 6 times runtime reduction, (3) theoretically characterizing the properties of the verifiable balls obtained by **LEVIS-α**, and (4) validating the approach across applications including electrical power flow regression and image classification, with demonstrated performance gains and geometric insights into the verifiable region.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑