arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.11370cs.CVcs.RO
收藏

DynamicGlue:动态环境中基于图神经网络的极线与时间信息数据关联

DynamicGlue: Epipolar and Time-Informed Data Association in Dynamic Environments using Graph Neural Networks

Theresa Huber, Simon Schaefer, Stefan Leutenegger

AI总结:

本文提出DynamicGlue,一种基于图神经网络的特征匹配方法,通过引入极线与时间信息并减少图边,在动态环境中排除运动物体关键点,同时保持匹配精度,显著提升SLAM系统在高度动态场景下的性能。

摘要:

在许多几何计算机视觉任务(如SLAM)中,静态环境假设很常见,但这限制了它们在高度动态场景中的适用性。由于这些任务依赖于在输入图像之间、环境的静态部分内识别点对应关系,我们提出了一种基于图神经网络的稀疏特征匹配网络,旨在挑战性条件下执行鲁棒匹配,同时排除运动物体上的关键点。我们采用了与最先进特征匹配网络类似的图边注意力聚合方案来增强关键点表示,但通过极线和时间信息增强图,并大幅减少图边数量。此外,我们引入了一种自监督训练方案,仅从未处理的视觉惯性数据中为动态环境中的图像对提取伪标签。一系列实验表明,与最先进的特征匹配网络相比,我们的网络在排除运动物体上的关键点方面表现出优越性能,同时在传统匹配指标上仍能达到相似结果。当集成到SLAM系统中时,我们的网络显著提升了性能,尤其是在高度动态场景中。

英文摘要:

The assumption of a static environment is common in many geometric computer vision tasks like SLAM but limits their applicability in highly dynamic scenes. Since these tasks rely on identifying point correspondences between input images within the static part of the environment, we propose a graph neural network-based sparse feature matching network designed to perform robust matching under challenging conditions while excluding keypoints on moving objects. We employ a similar scheme of attentional aggregation over graph edges to enhance keypoint representations as state-of-the-art feature-matching networks but augment the graph with epipolar and temporal information and vastly reduce the number of graph edges. Furthermore, we introduce a self-supervised training scheme to extract pseudo labels for image pairs in dynamic environments from exclusively unprocessed visual-inertial data. A series of experiments show the superior performance of our network as it excludes keypoints on moving objects compared to state-of-the-art feature matching networks while still achieving similar results regarding conventional matching metrics. When integrated into a SLAM system, our network significantly improves performance, especially in highly dynamic scenes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑