R-SCoRe:重新审视场景坐标回归以实现鲁棒的大规模视觉定位
R-SCoRe: Revisiting Scene Coordinate Regression for Robust Large-Scale Visual Localization
AI总结:
本文提出R-SCoRe方法,通过共视图全局编码、数据增强和深度调整重投影损失改进场景坐标回归,在大规模视觉定位中实现更高精度和更小地图尺寸。
摘要:
基于学习的视觉定位方法使用场景坐标回归(SCR),具有地图尺寸更小的优势。然而,在具有复杂光照变化或图像级歧义的数据集上,与特征匹配方法相比,它仍然是一种不够鲁棒的替代方案。本工作旨在缩小这一差距。我们引入了一种基于共视图的全局编码学习和数据增强策略,以及一种深度调整的重投影损失,以促进隐式三角化。此外,我们重新审视了网络架构和局部特征提取模块。我们的方法在不依赖网络集成或3D监督的情况下,在具有挑战性的大规模数据集上取得了最先进的性能。在Aachen Day-Night数据集上,我们比具有相似地图尺寸的先前SCR方法准确10倍,并且所需地图尺寸比任何其他SCR方法至少小5倍,同时仍能提供更优的精度。代码可在以下地址获取:https://github.com/cvg/scrstudio。
英文摘要:
Learning-based visual localization methods that use scene coordinate regression (SCR) offer the advantage of smaller map sizes. However, on datasets with complex illumination changes or image-level ambiguities, it remains a less robust alternative to feature matching methods. This work aims to close the gap. We introduce a covisibility graph-based global encoding learning and data augmentation strategy, along with a depth-adjusted reprojection loss to facilitate implicit triangulation. Additionally, we revisit the network architecture and local feature extraction module. Our method achieves state-of-the-art on challenging large-scale datasets without relying on network ensembles or 3D supervision. On Aachen Day-Night, we are 10$\times$ more accurate than previous SCR methods with similar map sizes and require at least 5$\times$ smaller map sizes than any other SCR method while still delivering superior accuracy. Code is available at: https://github.com/cvg/scrstudio .
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。