arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.09676cs.CVcs.AIcs.RO
收藏

nuScenes知识图谱——用于轨迹预测的交通场景综合语义表示

nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction

Heinrich Heine University Düsseldorf(杜塞尔多夫海因里希·海涅大学);Bosch Center for Artificial Intelligence(博世人工智能中心);Robert Bosch GmbH(罗伯特·博世有限公司);University of Osnabrück(奥斯纳布吕克大学);Technical University of Munich(慕尼黑工业大学)

Leon Mlodzian, Zhigang Sun, Hendrik Berkemeyer, Sebastian Monka, Zixu Wang, Stefan Dietze, Lavdim Halilaj, Juergen Luettin

AI总结:

本文提出利用知识图谱建模交通场景实体及其语义连接,构建了针对nuScenes数据集的nSKG知识图谱,并提供了适配PyG库的格式,以促进基于图神经网络的轨迹预测。

摘要:

交通场景中的轨迹预测涉及准确预测周围车辆的行为。为实现这一目标,至关重要的是考虑上下文信息,包括车辆的行驶路径、道路拓扑结构、车道分隔线以及交通规则。尽管研究表明利用异构上下文信息具有提升轨迹预测的潜力,但最先进的深度学习方法仍仅依赖于这些信息的有限子集。这主要是由于缺乏综合性的表示方法。本文提出了一种利用知识图谱来建模交通场景中各种实体及其语义连接的方法。此外,我们提出了nuScenes Knowledge Graph (nSKG),这是一个针对nuScenes数据集的知识图谱,它显式地建模了所有场景参与者和道路元素,以及它们之间的语义和空间关系。为了便于通过图神经网络使用nSKG进行轨迹预测,我们提供的数据格式可直接由PyG库使用。所有工件可在此处找到:https://github.com/boschresearch/nuScenes_Knowledge_Graph

英文摘要:

Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of vehicles, road topology, lane dividers, and traffic rules. Although studies demonstrated the potential of leveraging heterogeneous context for improving trajectory prediction, state-of-the-art deep learning approaches still rely on a limited subset of this information. This is mainly due to the limited availability of comprehensive representations. This paper presents an approach that utilizes knowledge graphs to model the diverse entities and their semantic connections within traffic scenes. Further, we present nuScenes Knowledge Graph (nSKG), a knowledge graph for the nuScenes dataset, that models explicitly all scene participants and road elements, as well as their semantic and spatial relationships. To facilitate the usage of the nSKG via graph neural networks for trajectory prediction, we provide the data in a format, ready-to-use by the PyG library. All artefacts can be found here: https://github.com/boschresearch/nuScenes_Knowledge_Graph

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑