arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.00542cs.LGcs.CR
收藏

用于神经网络验证的共享证书

Shared Certificates for Neural Network Verification

ETH Zurich(苏黎世联邦理工学院);Nostic Solutions AG(诺斯蒂克解决方案公司);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);VMware Research(威睿研究院)

Marc Fischer, Christian Sprecher, Dimitar I. Dimitrov, Gagandeep Singh, Martin Vechev

AI总结:

针对神经网络验证中从头独立证明导致开销高昂的问题,提出共享证书概念,利用中间层抽象的重叠特性跨输入复用证明工作,在不损失精度的前提下有效降低整体验证成本。

摘要:

现有的神经网络验证器通过传播每一层可达值的符号抽象,计算证明以确认每个输入在给定扰动下被正确处理。这一过程针对每个输入(如图像)和扰动(如旋转)从头独立重复,导致处理整个数据集时的总体证明开销高昂。在本工作中,基于不同输入和扰动在中间层获得的抽象可以重叠或相互包含这一关键洞察,我们引入了一种在不损失精度的情况下降低此验证成本的新方法。利用我们的洞察,我们引入了共享证书的通用概念,实现跨多个输入的证明工作复用,从而降低总体验证成本。我们进行了广泛的实验评估,以证明共享证书在降低图像分类器上一系列数据集和攻击规范(包括流行的补丁和几何扰动)的验证成本方面的有效性。我们在 https://github.com/eth-sri/proof-sharing 发布了实现。

英文摘要:

Existing neural network verifiers compute a proof that each input is handled correctly under a given perturbation by propagating a symbolic abstraction of reachable values at each layer. This process is repeated from scratch independently for each input (e.g., image) and perturbation (e.g., rotation), leading to an expensive overall proof effort when handling an entire dataset. In this work, we introduce a new method for reducing this verification cost without losing precision based on a key insight that abstractions obtained at intermediate layers for different inputs and perturbations can overlap or contain each other. Leveraging our insight, we introduce the general concept of shared certificates, enabling proof effort reuse across multiple inputs to reduce overall verification costs. We perform an extensive experimental evaluation to demonstrate the effectiveness of shared certificates in reducing the verification cost on a range of datasets and attack specifications on image classifiers including the popular patch and geometric perturbations. We release our implementation at https://github.com/eth-sri/proof-sharing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑