arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.13976cs.LGcs.AIcs.RO
收藏

基于强化学习的自动驾驶汽车安全覆盖和测试

Towards Automated Safety Coverage and Testing for Autonomous Vehicles with Reinforcement Learning

University of Virginia(弗吉尼亚大学)

Hyun Jae Cho, Madhur Behl

摘要:

自动驾驶汽车(AV)安全测试可能需要的闭环验证超出了传统测试方法和离散验证的范围。验证将自动驾驶汽车系统置于其发布后在日常驾驶中可能遇到的场景或情况下进行测试。这些场景可以直接在物理(封闭试验场)或虚拟(模拟预定义场景)环境中控制,也可以在现实世界中的操作过程中自发出现(开放道路测试或模拟随机生成的场景)。在自动驾驶测试中,仿真主要有两个目的:帮助开发强大的自动驾驶汽车,并在发布前测试和验证自动驾驶汽车。由于涉及大量变量(其中大多数是连续的),从上述每个来源可以构建大量的情景变化,这带来了挑战。即使连续变量离散化,可能的组合数量也变得实际上不可行。为了克服这一挑战,我们建议使用强化学习(RL)来生成AV软件实现的失败示例和意外交通情况。尽管强化学习算法在游戏和一些机器人操作中取得了显著的效果,但这种技术还没有被广泛扩展到更具挑战性的现实世界应用中,如自动驾驶。

英文摘要:

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test in scenarios or situations that the system would likely encounter in everyday driving after its release. These scenarios can either be controlled directly in a physical (closed-course proving ground) or virtual (simulation of predefined scenarios) environment, or they can arise spontaneously during operation in the real world (open-road testing or simulation of randomly generated scenarios). In AV testing, simulation serves primarily two purposes: to assist the development of a robust autonomous vehicle and to test and validate the AV before release. A challenge arises from the sheer number of scenario variations that can be constructed from each of the above sources due to the high number of variables involved (most of which are continuous). Even with continuous variables discretized, the possible number of combinations becomes practically infeasible to test. To overcome this challenge we propose using reinforcement learning (RL) to generate failure examples and unexpected traffic situations for the AV software implementation. Although reinforcement learning algorithms have achieved notable results in games and some robotic manipulations, this technique has not been widely scaled up to the more challenging real world applications like autonomous driving.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑