arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.09080cs.CV

BevSplat: 通过基于特征的高斯基元解决高度歧义以实现弱监督跨视角定位

BevSplat: Resolving Height Ambiguity via Feature-Based Gaussian Primitives for Weakly-Supervised Cross-View Localization

ShanghaiTech University(上海科技大学)

Qiwei Wang, Shaoxun Wu, Yujiao Shi

AI总结:

BevSplat通过基于特征的高斯基元解决高度歧义,提升弱监督跨视角定位的精度。

摘要:

本文针对弱监督跨视角定位问题,目标是估计地面相机相对于卫星图像的姿态,使用噪声标注的地面真实信息。一种常见的跨视角领域差距桥接方法是鸟瞰图(BEV)合成。然而,现有方法由于地面图像和卫星高度图中缺乏深度信息而难以解决高度歧义。先前的解决方案要么假设平坦的地面平面,要么依赖复杂的模型,如跨视角转换器。我们提出了BevSplat,一种新的方法,通过使用基于特征的高斯基元来解决高度歧义。每个地面图像中的像素都用具有语义和空间特征的3D高斯表示,这些特征被合成到BEV特征图中以进行相对姿态估计。此外,为了解决全景查询图像的挑战,我们引入了基于二十面体的监督策略用于高斯基元。我们在广泛使用的KITTI和VIGOR数据集上验证了我们的方法,这些数据集包含针孔和全景查询图像。实验结果表明,BevSplat在先前方法上显著提高了定位精度。

英文摘要:

This paper addresses the problem of weakly supervised cross-view localization, where the goal is to estimate the pose of a ground camera relative to a satellite image with noisy ground truth annotations. A common approach to bridge the cross-view domain gap for pose estimation is Bird's-Eye View (BEV) synthesis. However, existing methods struggle with height ambiguity due to the lack of depth information in ground images and satellite height maps. Previous solutions either assume a flat ground plane or rely on complex models, such as cross-view transformers. We propose BevSplat, a novel method that resolves height ambiguity by using feature-based Gaussian primitives. Each pixel in the ground image is represented by a 3D Gaussian with semantic and spatial features, which are synthesized into a BEV feature map for relative pose estimation. Additionally, to address challenges with panoramic query images, we introduce an icosphere-based supervision strategy for the Gaussian primitives. We validate our method on the widely used KITTI and VIGOR datasets, which include both pinhole and panoramic query images. Experimental results show that BevSplat significantly improves localization accuracy over prior approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑