使用空间与语义数据解决单目关键帧视觉SLAM中的短期重定位问题
Solving Short-Term Relocalization Problems In Monocular Keyframe Visual SLAM Using Spatial And Semantic Data
AI总结:
本文针对单目关键帧视觉SLAM中的短期重定位问题,提出了一种融合语义与空间信息的多模态关键帧描述子,并构建了多阶段关键帧过滤的KPR方法,在室内GPS拒止数据集上实现了优于词袋方法的精确位姿恢复。
摘要:
在单目关键帧视觉同步定位与建图(MKVSLAM)框架中,当增量位置跟踪失败时,必须在短时间窗口内恢复全局位姿,这也被称为短期重定位。这种能力对于移动机器人实现可靠导航、构建精确地图以及在与人类协作者互动时表现出精准行为至关重要。本文专注于使用单目相机系统开发移动机器人的鲁棒短期重定位能力。本文引入了一种新颖的多模态关键帧描述子,其中包含在环境中检测到的物体的语义信息以及相机的空间信息。利用该描述子,提出了一种新的基于关键帧的位置识别(KPR)方法,该方法被构建为多阶段关键帧过滤算法,从而形成了一种新的MKVSLAM系统重定位流水线。所提出的方法在多个室内GPS拒止数据集上进行了评估,与词袋方法相比,展示了精确的位姿恢复能力。
英文摘要:
In Monocular Keyframe Visual Simultaneous Localization and Mapping (MKVSLAM) frameworks, when incremental position tracking fails, global pose has to be recovered in a short-time window, also known as short-term relocalization. This capability is crucial for mobile robots to have reliable navigation, build accurate maps, and have precise behaviors around human collaborators. This paper focuses on the development of robust short-term relocalization capabilities for mobile robots using a monocular camera system. A novel multimodal keyframe descriptor is introduced, that contains semantic information of objects detected in the environment and the spatial information of the camera. Using this descriptor, a new Keyframe-based Place Recognition (KPR) method is proposed that is formulated as a multi-stage keyframe filtering algorithm, leading to a new relocalization pipeline for MKVSLAM systems. The proposed approach is evaluated over several indoor GPS denied datasets and demonstrates accurate pose recovery, in comparison to a bag-of-words approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。