arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.01019cs.CV
收藏

利用深度视觉描述符进行分层高效定位

Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization

ETH Zürich(苏黎世联邦理工学院)

Paul-Edouard Sarlin, Frédéric Debraine, Marcin Dymczyk, Roland Siegwart, Cesar Cadena

摘要:

许多机器人应用需要精确的姿态估计,尽管在大型和不断变化的环境中运行。这可以通过视觉定位来解决,使用预先计算的周围环境的3D模型。姿态估计相当于使用局部描述符找到查询图像中的2D关键点与模型中的3D点之间的对应关系。然而,机器人平台的计算能力通常有限,这使得这项任务在大规模环境中具有挑战性。二进制特征描述符显着加快了这种2D-3D匹配,并已成为流行的机器人社区,但也强烈削弱了鲁棒性感知混淆和视点,照明和场景结构的变化。在这项工作中,我们建议利用深度学习的最新进展来执行有效的分层定位。我们首先使用学习的图像范围的全局描述符在地图级别进行定位,然后仅根据候选位置中计算的2D-3D匹配来估计精确的姿势。这限制了本地搜索,从而允许有效地利用强大的非二进制描述符,这些描述符通常在资源受限的设备上被忽略。我们的方法可以在流行的移动平台上实时运行时实现最先进的本地化性能,从而为机器人研究带来新的前景。

英文摘要:

Many robotics applications require precise pose estimates despite operating in large and changing environments. This can be addressed by visual localization, using a pre-computed 3D model of the surroundings. The pose estimation then amounts to finding correspondences between 2D keypoints in a query image and 3D points in the model using local descriptors. However, computational power is often limited on robotic platforms, making this task challenging in large-scale environments. Binary feature descriptors significantly speed up this 2D-3D matching, and have become popular in the robotics community, but also strongly impair the robustness to perceptual aliasing and changes in viewpoint, illumination and scene structure. In this work, we propose to leverage recent advances in deep learning to perform an efficient hierarchical localization. We first localize at the map level using learned image-wide global descriptors, and subsequently estimate a precise pose from 2D-3D matches computed in the candidate places only. This restricts the local search and thus allows to efficiently exploit powerful non-binary descriptors usually dismissed on resource-constrained devices. Our approach results in state-of-the-art localization performance while running in real-time on a popular mobile platform, enabling new prospects for robotics research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑