arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.18343cs.AI
收藏

通过用于自动驾驶的RL微调改进智能体行为

Improving Agent Behaviors with RL Fine-tuning for Autonomous Driving

UCLA(加州大学洛杉矶分校);Waymo(Waymo公司)

Zhenghao Peng, Wenjie Luo, Yiren Lu, Tianyi Shen, Cole Gulino, Ari Seff, Justin Fu

AI总结:

本研究通过强化学习闭环微调行为模型,解决了监督学习模型在自动驾驶测试时的分布偏移问题,提升了智能体行为可靠性,并在Waymo挑战赛和新提出的策略评估基准上验证了有效性。

摘要:

自动驾驶研究中的一个主要挑战是对智能体行为进行建模,这具有重要的应用,包括构建真实可靠的仿真用于车外评估,以及预测车载规划的交通智能体运动。尽管监督学习在跨领域智能体建模方面取得了成功,但这些模型在测试时部署可能会面临分布偏移问题。在本研究中,我们通过使用强化学习对行为模型进行闭环微调,提升了智能体行为的可靠性。我们的方法在Waymo Open Sim Agents挑战赛上展示了整体性能的提升,以及碰撞率等目标指标的改善。此外,我们提出了一种新颖的策略评估基准,用于直接评估仿真智能体衡量自动驾驶车辆规划器质量的能力,并展示了我们的方法在这一新基准上的有效性。

英文摘要:

A major challenge in autonomous vehicle research is modeling agent behaviors, which has critical applications including constructing realistic and reliable simulations for off-board evaluation and forecasting traffic agents motion for onboard planning. While supervised learning has shown success in modeling agents across various domains, these models can suffer from distribution shift when deployed at test-time. In this work, we improve the reliability of agent behaviors by closed-loop fine-tuning of behavior models with reinforcement learning. Our method demonstrates improved overall performance, as well as improved targeted metrics such as collision rate, on the Waymo Open Sim Agents challenge. Additionally, we present a novel policy evaluation benchmark to directly assess the ability of simulated agents to measure the quality of autonomous vehicle planners and demonstrate the effectiveness of our approach on this new benchmark.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑