arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.07413cs.ROcs.AI
收藏

基于强化学习的安全机动目录高层决策

High-level Decisions from a Safe Maneuver Catalog with Reinforcement Learning for Safe and Cooperative Automated Merging

Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)

Danial Kamran, Yu Ren, Martin Lauer

摘要:

强化学习(RL)最近被用于解决自动驾驶背景下具有挑战性的决策问题。然而,所提出的基于RL的策略的主要缺点之一是缺乏安全保证,因为它们努力减少预期的碰撞次数,但仍然容忍它们。在本文中,我们提出了一个有效的基于RL的决策管道,用于合并场景中的安全和合作自动驾驶。RL代理能够预测当前情况并提供高层决策,指定负责安全的低级计划器的操作模式。为了学习更通用的策略,我们提出了一个可扩展的RL架构的合并方案,是不敏感的环境配置的变化。根据我们的实验,建议RL代理可以有效地识别合作的司机从他们的车辆状态历史,并产生交互式操纵,从而更快,更舒适的自动驾驶。同时,由于规划器内部的安全约束,所有的机动都是无碰撞和安全的。

英文摘要:

Reinforcement learning (RL) has recently been used for solving challenging decision-making problems in the context of automated driving. However, one of the main drawbacks of the presented RL-based policies is the lack of safety guarantees, since they strive to reduce the expected number of collisions but still tolerate them. In this paper, we propose an efficient RL-based decision-making pipeline for safe and cooperative automated driving in merging scenarios. The RL agent is able to predict the current situation and provide high-level decisions, specifying the operation mode of the low level planner which is responsible for safety. In order to learn a more generic policy, we propose a scalable RL architecture for the merging scenario that is not sensitive to changes in the environment configurations. According to our experiments, the proposed RL agent can efficiently identify cooperative drivers from their vehicle state history and generate interactive maneuvers, resulting in faster and more comfortable automated driving. At the same time, thanks to the safety constraints inside the planner, all of the maneuvers are collision free and safe.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑