arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.01993cs.RO
收藏

用于自动驾驶策略学习的深度RL和IL综述

A Survey of Deep RL and IL for Autonomous Driving Policy Learning

Peking University(北京大学)

Zeyu Zhu, Huijing Zhao

摘要:

自动驾驶(AD)代理基于在线感知结果生成驾驶策略,这些结果是在多个抽象层次上获得的,例如,行为规划、运动规划和控制。驾驶策略对于实现安全、高效、和谐的驾驶行为至关重要,而复杂场景下的AD智能体仍然面临着巨大的挑战。由于它们在机器人和视频游戏等领域的成功应用,近年来,使用深度强化学习(DRL)和深度模仿学习(DIL)技术来导出AD策略已经见证了大量的研究工作。本文是一个全面的调查,这是在三个层次上进行的工作:首先,从系统的角度构建了一个分类的文献研究,其中DRL/DIL模型集成到AD架构的五种模式被确定。其次,制定DRL/DIL模型进行指定的AD任务进行全面审查,其中各种设计的模型状态和动作空间和强化学习奖励。最后,进行了深入的审查如何AD应用程序的驾驶安全,与其他交通参与者和环境的不确定性的相互作用的关键问题是解决的DRL/DIL模型。据我们所知,这是第一次调查,重点是反倾销策略学习使用DRL/DIL,这是解决同时从系统,任务驱动和问题驱动的角度。我们分享和讨论的结果,这可能导致在未来的各种主题的调查。

英文摘要:

Autonomous driving (AD) agents generate driving policies based on online perception results, which are obtained at multiple levels of abstraction, e.g., behavior planning, motion planning and control. Driving policies are crucial to the realization of safe, efficient and harmonious driving behaviors, where AD agents still face substantial challenges in complex scenarios. Due to their successful application in fields such as robotics and video games, the use of deep reinforcement learning (DRL) and deep imitation learning (DIL) techniques to derive AD policies have witnessed vast research efforts in recent years. This paper is a comprehensive survey of this body of work, which is conducted at three levels: First, a taxonomy of the literature studies is constructed from the system perspective, among which five modes of integration of DRL/DIL models into an AD architecture are identified. Second, the formulations of DRL/DIL models for conducting specified AD tasks are comprehensively reviewed, where various designs on the model state and action spaces and the reinforcement learning rewards are covered. Finally, an in-depth review is conducted on how the critical issues of AD applications regarding driving safety, interaction with other traffic participants and uncertainty of the environment are addressed by the DRL/DIL models. To the best of our knowledge, this is the first survey to focus on AD policy learning using DRL/DIL, which is addressed simultaneously from the system, task-driven and problem-driven perspectives. We share and discuss findings, which may lead to the investigation of various topics in the future.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑