arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2002.00434cs.AI
收藏

集成深度强化学习和基于模型的路径规划的自动驾驶

Integrating Deep Reinforcement Learning with Model-based Path Planners for Automated Driving

The Ohio State University(俄亥俄州立大学)

Ekim Yurtsever, Linda Capito, Keith Redmill, Umit Ozguner

摘要:

城市环境中的自动驾驶具有挑战性。人类参与行为很难建模,传统的基于规则的自动驾驶系统(ADS)在面对未建模的动态时往往会失败。另一方面,最近,基于端到端深度强化学习(DRL)的无模型ADS已经显示出有希望的结果。然而,纯基于学习的方法缺乏基于模型的控制器的硬编码安全措施。在这里,我们提出了一种混合的方法,将路径规划管道集成到基于视觉的DRL框架,以减轻这两个世界的缺点。总之,DRL代理被训练为尽可能接近地跟随路径规划器的航路点。智能体通过与环境交互来学习该策略。奖励函数包含两个主要项:偏离路径规划器的惩罚和发生碰撞的惩罚。后者以具有显著更大的数值的形式具有优先权。实验结果表明,该方法可以规划其路径和导航之间的随机选择的起点和终点的CARLA,一个动态的城市模拟环境。我们的代码是开源的,可以在线获得。

英文摘要:

Automated driving in urban settings is challenging. Human participant behavior is difficult to model, and conventional, rule-based Automated Driving Systems (ADSs) tend to fail when they face unmodeled dynamics. On the other hand, the more recent, end-to-end Deep Reinforcement Learning (DRL) based model-free ADSs have shown promising results. However, pure learning-based approaches lack the hard-coded safety measures of model-based controllers. Here we propose a hybrid approach for integrating a path planning pipe into a vision based DRL framework to alleviate the shortcomings of both worlds. In summary, the DRL agent is trained to follow the path planner's waypoints as close as possible. The agent learns this policy by interacting with the environment. The reward function contains two major terms: the penalty of straying away from the path planner and the penalty of having a collision. The latter has precedence in the form of having a significantly greater numerical value. Experimental results show that the proposed method can plan its path and navigate between randomly chosen origin-destination points in CARLA, a dynamic urban simulation environment. Our code is open-source and available online.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑