arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.03191cs.RO
收藏

基于频谱注意力网络与近端策略优化的意图预测与决策一体化方法

Integrated Intention Prediction and Decision-Making with Spectrum Attention Net and Proximal Policy Optimization

The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学)

Xiao Zhou, Chengzhen Meng, Wenru Liu, Zengqi Peng, Ming Liu, Jun Ma

AI总结:

本文提出一种基于频谱注意力网络和PPO的自动驾驶意图预测与决策一体化方法,通过联合学习建模二者耦合关系,在保证计算效率的同时提升驾驶成功率、效率与安全性。

摘要:

对于高度动态环境中的自动驾驶,需要预测周围车辆(SVs)的未来行为并做出安全有效的决策。然而,对预测模块与决策模块之间固有耦合效应进行建模一直是一个长期挑战,尤其是在需要保持适当计算效率的情况下。为了解决这些问题,我们提出了一种新颖的意图预测与决策一体化方法,该方法显式建模耦合关系并实现高效计算。具体而言,设计了一种频谱注意力网络,通过捕捉每个频率分量随时间变化的趋势及其相互关系来预测周围车辆的意图。由于在执行过程中预测的意图不会被解码为轨迹,因此意图预测模块实现了快速计算。此外,采用近端策略优化(PPO)算法,通过其目标函数中的裁剪机制实现适度策略更新,从而解决框架中的非平稳问题。在上述工作的基础上,意图预测模块和决策模块通过联合学习实现一体化。在代表性交通场景中进行了实验,结果表明,所提出的一体化框架在驾驶任务的成功率、效率和安全性方面均优于多个深度强化学习(DRL)基线方法。

英文摘要:

For autonomous driving in highly dynamic environments, it is anticipated to predict the future behaviors of surrounding vehicles (SVs) and make safe and effective decisions. However, modeling the inherent coupling effect between the prediction and decision-making modules has been a long-standing challenge, especially when there is a need to maintain appropriate computational efficiency. To tackle these problems, we propose a novel integrated intention prediction and decision-making approach, which explicitly models the coupling relationship and achieves efficient computation. Specifically, a spectrum attention net is designed to predict the intentions of SVs by capturing the trends of each frequency component over time and their interrelations. Fast computation of the intention prediction module is attained as the predicted intentions are not decoded to trajectories in the executing process. Furthermore, the proximal policy optimization (PPO) algorithm is employed to address the non-stationary problem in the framework through a modest policy update enabled by a clipping mechanism within its objective function. On the basis of these developments, the intention prediction and decision-making modules are integrated through joint learning. Experiments are conducted in representative traffic scenarios, and the results reveal that the proposed integrated framework demonstrates superior performance over several deep reinforcement learning (DRL) baselines in terms of success rate, efficiency, and safety in driving tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑