arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.04164cs.AIcs.SE
收藏

基于Scenic和VerifAI的并行多目标证伪

Parallel and Multi-Objective Falsification with Scenic and VerifAI

University of California, Berkeley(加州大学伯克利分校);University of California, Santa Cruz(加州大学圣克鲁兹分校)

Kesav Viswanadha, Edward Kim, Francis Indaheng, Daniel J. Fremont, Sanjit A. Seshia

摘要:

证伪已经成为基于仿真的自治系统验证的重要工具。在本文中,我们提出了扩展的场景场景规约语言和VerifAI工具包,提高了可扩展性的采样为基础的伪造方法,通过使用并行和扩展伪造多目标规范。我们首先提出了一个并行化的框架,该框架与Scenic的模拟和采样功能以及VerifAI的伪造功能相结合,减少了基于模拟的测试中固有的执行时间瓶颈。然后,我们提出了VerifAI的证伪算法的扩展,以支持采样过程中的多目标优化,使用规则手册的概念来指定多个度量的偏好排序,这些度量可用于指导反例搜索过程。最后,我们评估这些扩展的好处与一套全面的基准写在风景语言。

英文摘要:

Falsification has emerged as an important tool for simulation-based verification of autonomous systems. In this paper, we present extensions to the Scenic scenario specification language and VerifAI toolkit that improve the scalability of sampling-based falsification methods by using parallelism and extend falsification to multi-objective specifications. We first present a parallelized framework that is interfaced with both the simulation and sampling capabilities of Scenic and the falsification capabilities of VerifAI, reducing the execution time bottleneck inherently present in simulation-based testing. We then present an extension of VerifAI's falsification algorithms to support multi-objective optimization during sampling, using the concept of rulebooks to specify a preference ordering over multiple metrics that can be used to guide the counterexample search process. Lastly, we evaluate the benefits of these extensions with a comprehensive set of benchmarks written in the Scenic language.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑