arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.13796cs.SEcs.AI
收藏

使用Scenic和VerifAI应对PDKEEPAAAAB测试挑战

Addressing the IEEE AV Test Challenge with Scenic and VerifAI

University of California, Berkeley(加州大学伯克利分校);University of California, Santa Cruz(加州大学圣克鲁兹分校)

Kesav Viswanadha, Francis Indaheng, Justin Wong, Edward Kim, Ellen Kalvan, Yash Pant, Daniel J. Fremont, Sanjit A. Seshia

摘要:

本文总结了我们的正式方法来测试自动驾驶汽车(AV)在模拟IEEE AV测试挑战。我们展示了一个系统的测试框架,利用我们以前的工作正式驱动的智能网络物理系统的模拟。首先,为了建模和生成涉及多个代理的交互式场景,我们使用Scenic,一种用于指定场景的概率程序设计语言。Scenic程序将抽象场景定义为物理对象及其行为随时间的分布。从一个抽象的场景中取样,可以产生许多不同的具体场景,这些场景可以作为AV的测试用例运行。从编码抽象驾驶场景的Scenic程序开始,我们可以使用VerifAI工具包在场景中搜索与多个AV评估指标相关的失败案例。我们证明了我们的测试框架的有效性,确定具体的失败场景的开源自动驾驶仪,阿波罗,从各种现实的交通场景。

英文摘要:

This paper summarizes our formal approach to testing autonomous vehicles (AVs) in simulation for the IEEE AV Test Challenge. We demonstrate a systematic testing framework leveraging our previous work on formally-driven simulation for intelligent cyber-physical systems. First, to model and generate interactive scenarios involving multiple agents, we used Scenic, a probabilistic programming language for specifying scenarios. A Scenic program defines an abstract scenario as a distribution over configurations of physical objects and their behaviors over time. Sampling from an abstract scenario yields many different concrete scenarios which can be run as test cases for the AV. Starting from a Scenic program encoding an abstract driving scenario, we can use the VerifAI toolkit to search within the scenario for failure cases with respect to multiple AV evaluation metrics. We demonstrate the effectiveness of our testing framework by identifying concrete failure scenarios for an open-source autopilot, Apollo, starting from a variety of realistic traffic scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑