arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.09313cs.LGcs.LO
收藏

生成与验证:神经网络感知系统的语义有意义形式化分析

Generate and Verify: Semantically Meaningful Formal Analysis of Neural Network Perception Systems

HRL Laboratories LLC(HRL实验室有限责任公司)

Chris R. Serrano, Pape M. Sylla, Michael A. Warren

摘要:

测试仍然是评估神经网络感知系统准确性的主要方法。神经网络感知模型的形式化验证的先前工作已被限制到相对于个体图像输入的分类的局部对抗鲁棒性的概念。在这项工作中,我们提出了一个概念的全局正确性的神经网络感知模型进行回归生成神经网络与语义有意义的潜在空间。也就是说,针对生成模型在其潜在空间的间隔上产生的无限图像集,我们采用神经网络验证来证明该模型将始终在地面真实的某些误差范围内产生估计。在感知模型失败的地方,我们获得语义上有意义的反例,这些反例携带感兴趣的系统的具体状态的信息,这些信息可以在没有人类检查相应生成的图像的情况下以编程方式使用。我们的方法,生成和验证,提供了一种新的技术来收集洞察神经网络感知系统的故障情况,并提供有意义的保证,在安全关键应用程序的正确行为。

英文摘要:

Testing remains the primary method to evaluate the accuracy of neural network perception systems. Prior work on the formal verification of neural network perception models has been limited to notions of local adversarial robustness for classification with respect to individual image inputs. In this work, we propose a notion of global correctness for neural network perception models performing regression with respect to a generative neural network with a semantically meaningful latent space. That is, against an infinite set of images produced by a generative model over an interval of its latent space, we employ neural network verification to prove that the model will always produce estimates within some error bound of the ground truth. Where the perception model fails, we obtain semantically meaningful counter-examples which carry information on concrete states of the system of interest that can be used programmatically without human inspection of corresponding generated images. Our approach, Generate and Verify, provides a new technique to gather insight into the failure cases of neural network perception systems and provide meaningful guarantees of correct behavior in safety critical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑