arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.03863cs.ROcs.AI
收藏

学习自动驾驶的分层行为和运动规划

Learning hierarchical behavior and motion planning for autonomous driving

Zhejiang University(浙江大学);Arizona State University(亚利桑那州立大学)

Jingke Wang, Yue Wang, Dongkun Zhang, Yezhou Yang, Rong Xiong

摘要:

基于学习的驾驶解决方案是自动驾驶的一个新分支,它通过从数据中学习底层机制来简化驾驶建模。为了提高基于学习的驾驶解决方案的战术决策,我们引入分层行为和运动规划(HBMP)明确建模的行为,基于学习的解决方案。由于行为和运动的耦合行为空间,使用强化学习(RL)解决长时间驾驶任务的HBMP问题具有挑战性。我们通过整合一个经典的基于采样的运动规划器来转换HBMP问题,其中的最优成本被视为高级行为学习的奖励。因此,该公式减少了行动空间,并多样化的奖励,而不会失去HBMP的最优性。此外,我们提出了一种跨仿真平台和真实世界环境的输入传感数据的可共享表示,以便在基于事件的快速仿真器SUMO中训练的模型可以用于在基于动态的仿真器CARLA中初始化和加速RL训练。实验结果证明了该方法的有效性。此外,该模型被成功地转移到现实世界中,验证了泛化能力。

英文摘要:

Learning-based driving solution, a new branch for autonomous driving, is expected to simplify the modeling of driving by learning the underlying mechanisms from data. To improve the tactical decision-making for learning-based driving solution, we introduce hierarchical behavior and motion planning (HBMP) to explicitly model the behavior in learning-based solution. Due to the coupled action space of behavior and motion, it is challenging to solve HBMP problem using reinforcement learning (RL) for long-horizon driving tasks. We transform HBMP problem by integrating a classical sampling-based motion planner, of which the optimal cost is regarded as the rewards for high-level behavior learning. As a result, this formulation reduces action space and diversifies the rewards without losing the optimality of HBMP. In addition, we propose a sharable representation for input sensory data across simulation platforms and real-world environment, so that models trained in a fast event-based simulator, SUMO, can be used to initialize and accelerate the RL training in a dynamics based simulator, CARLA. Experimental results demonstrate the effectiveness of the method. Besides, the model is successfully transferred to the real-world, validating the generalization capability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑