arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.13237cs.RO
收藏

用于图像导航的时空图定位网络

Spatio-Temporal Graph Localization Networks for Image-based Navigation

Toyota Central R&D Labs., INC(丰田中央研发实验室有限公司)

Takahiro Niwa, Shun Taguchi, Noriaki Hirose

摘要:

拓扑地图中的定位对于使用RGB相机的基于图像的导航至关重要。在中型到大型环境中,仅使用一个摄像头进行定位可能具有挑战性,因为通常会重复观察到外观相似的图像,特别是在室内环境中。为了克服这个问题,我们提出了一种基于学习的定位方法,同时利用拓扑地图的空间一致性和时间序列图像捕获的机器人的时间一致性。我们的方法结合了卷积神经网络(CNN)来嵌入图像特征和递归型图神经网络来执行准确的定位。当训练我们的模型时,在真实世界环境中捕获图像时,很难获得机器人的地面真实姿态。因此,我们提出了一个sim2real传输方法与半监督学习,利用模拟器图像与地面实况构成除了真实图像。我们对我们的方法进行了定量和定性评估,并将其与几种最先进的基线进行了比较。在地图包含相似图像的环境中,所提出的方法优于基线。此外,我们评估了一个基于图像的导航系统,结合我们的定位方法,并确认导航精度显着提高在模拟器和真实环境中相比,其他基线方法。

英文摘要:

Localization in topological maps is essential for image-based navigation using an RGB camera. Localization using only one camera can be challenging in medium-to-large-sized environments because similar-looking images are often observed repeatedly, especially in indoor environments. To overcome this issue, we propose a learning-based localization method that simultaneously utilizes the spatial consistency from topological maps and the temporal consistency from time-series images captured by the robot. Our method combines a convolutional neural network (CNN) to embed image features and a recurrent-type graph neural network to perform accurate localization. When training our model, it is difficult to obtain the ground truth pose of the robot when capturing images in real-world environments. Hence, we propose a sim2real transfer approach with semi-supervised learning that leverages simulator images with the ground truth pose in addition to real images. We evaluated our method quantitatively and qualitatively and compared it with several state-of-the-art baselines. The proposed method outperformed the baselines in environments where the map contained similar images. Moreover, we evaluated an image-based navigation system incorporating our localization method and confirmed that navigation accuracy significantly improved in the simulator and real environments when compared with the other baseline methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑