arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.02767cs.LG
收藏

基于Transformer的自动驾驶系统空间与社交情境感知轨迹预测

Spatial and social situation-aware transformer-based trajectory prediction of autonomous systems

University of Duisburg-Essen(杜伊斯堡-埃森大学);Institute of Ship Technology, Ocean Engineering and Transport Systems(船舶技术、海洋工程与交通系统研究所);Chair of Dynamics and Control(动力学与控制讲席)

Kathrin Donandt, Dirk Söffker

AI总结:

提出基于Transformer的轨迹预测模型,通过Social Tensor Transformer高效处理社交张量并结合空间限制,在长预测跨度下降低偏差并实现可解释的智能体反应预测。

摘要:

诸如道路车辆或船舶等自主交通系统需要考虑静态和动态环境,以实现无碰撞移动。在给定情境下预测智能体的行为是及时做出适当反应所必需的。近年来,开发基于深度学习的模型已成为运动预测的主导方法。社交环境通常通过一个基于CNN-LSTM的子模块来处理,该子模块处理包含周围智能体过去轨迹信息的社交张量(social tensor)。对于所提出的基于Transformer的轨迹预测模型,本文提出了一种替代的、计算效率更高的社交张量定义和处理方法。它直接考虑每个时间步目标智能体与周围智能体之间的相互依赖关系,而不是依赖于单独处理的智能体最后隐藏LSTM状态的信息。一个基于Transformer的子模块,即Social Tensor Transformer,被集成到整体预测模型中。它负责利用从社交张量获得的社交交互信息来丰富目标智能体的移动特征。为了感知空间限制,移动特征是根据可航行区域来定义的。这取代了额外的、计算成本高昂的地图处理子模块。消融研究表明,对于较长的预测时间跨度,与对空间和社交信息不敏感的模型相比,预测轨迹与真实值的偏差更低。即使从仅考虑空间的模型到空间和社交情境敏感模型在常用误差指标上的性能提升较小,但通过可视化结果可以表明,所提出的模型实际上能够预测对周围智能体的反应,并明确地实现了可解释的行为。

英文摘要:

Autonomous transportation systems such as road vehicles or vessels require the consideration of the static and dynamic environment to dislocate without collision. Anticipating the behavior of an agent in a given situation is required to adequately react to it in time. Developing deep learning-based models has become the dominant approach to motion prediction recently. The social environment is often considered through a CNN-LSTM-based sub-module processing a $\textit{social tensor}$ that includes information of the past trajectory of surrounding agents. For the proposed transformer-based trajectory prediction model, an alternative, computationally more efficient social tensor definition and processing is suggested. It considers the interdependencies between target and surrounding agents at each time step directly instead of relying on information of last hidden LSTM states of individually processed agents. A transformer-based sub-module, the Social Tensor Transformer, is integrated into the overall prediction model. It is responsible for enriching the target agent's dislocation features with social interaction information obtained from the social tensor. For the awareness of spatial limitations, dislocation features are defined in relation to the navigable area. This replaces additional, computationally expensive map processing sub-modules. An ablation study shows, that for longer prediction horizons, the deviation of the predicted trajectory from the ground truth is lower compared to a spatially and socially agnostic model. Even if the performance gain from a spatial-only to a spatial and social context-sensitive model is small in terms of common error measures, by visualizing the results it can be shown that the proposed model in fact is able to predict reactions to surrounding agents and explicitely allows an interpretable behavior.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑