arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.06018cs.SE
收藏

TARGET:基于经验证的LLM引导知识提取、从交通规则自动生成自动驾驶汽车测试场景的方法

TARGET: Automated Scenario Generation from Traffic Rules for Testing Autonomous Vehicles via Validated LLM-Guided Knowledge Extraction

Macquarie University(麦考瑞大学);Purdue University(普渡大学);TensorBlock

Yao Deng, Jiaohong Yao, Zhi Tu, Xi Zheng, Mengshi Zhang, Tianyi Zhang

AI总结:

针对自动驾驶系统测试场景构建成本高的问题,提出TARGET框架,通过经验证的LLM引导知识提取与领域特定语言,从交通规则自动生成测试场景,实验验证其可有效发现系统违规与故障。

摘要:

近期发生的自动驾驶汽车事故凸显了开展严格测试以保障安全性与鲁棒性的必要性。然而,为自动驾驶系统(ADSs)构建测试场景是一项劳动密集型工作。我们提出TARGET——一种可从交通规则自动生成测试场景的端到端框架。为应对场景构建的复杂性,我们利用大语言模型(LLM)从交通规则中提取知识。为缓解输入处理过程中因大上下文引发的幻觉问题,我们引入了一种语法简单、具备组合性的领域特定语言(DSL)。这种设计使LLM能够以模块化方式学习并生成测试场景,同时可对每个组件进行语法与语义验证。基于这些经验证的表示,TARGET合成可执行脚本,在仿真环境中渲染场景。我们用从54条交通规则衍生的284个场景对7个ADSs进行了评估,TARGET共发现610起规则违反、碰撞及其他问题。针对每一起违规,TARGET都会生成场景记录与详细日志,为根因分析提供支持。其中两个已识别的问题得到了ADS开发者的确认:一个与现有缺陷报告相关,另一个与ADS功能有限有关。

英文摘要:

Recent incidents with autonomous vehicles highlight the need for rigorous testing to ensure safety and robustness. Constructing test scenarios for autonomous driving systems (ADSs), however, is labor-intensive. We propose TARGET, an end-to-end framework that automatically generates test scenarios from traffic rules. To address complexity, we leverage a Large Language Model (LLM) to extract knowledge from traffic rules. To mitigate hallucinations caused by large context during input processing, we introduce a domain-specific language (DSL) designed to be syntactically simple and compositional. This design allows the LLM to learn and generate test scenarios in a modular manner while enabling syntactic and semantic validation for each component. Based on these validated representations, TARGET synthesizes executable scripts to render scenarios in simulation. Evaluated seven ADSs with 284 scenarios derived from 54 traffic rules, TARGET uncovered 610 rule violations, collisions, and other issues. For each violation, TARGET generates scenario recordings and detailed logs, aiding root cause analysis. Two identified issues were confirmed by ADS developers: one linked to an existing bug report and the other to limited ADS functionality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑