arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.08491cs.CV
收藏

全球跨模态地理定位:一个百万级数据集和一个物理一致性学习框架

Global Cross-Modal Geo-Localization: A Million-Scale Dataset and a Physical Consistency Learning Framework

School of Remote Sensing and Information Engineering, Wuhan University(武汉大学遥感与信息工程学院);First Surveying and Mapping Institute of Hunan Province(湖南省第一测绘院)

Yutong Hu, Jinhui Chen, Chaoqiang Xu, Yuan Kou, Sili Zhou, Shaocheng Yan, Pengcheng Shi, Qingwu Hu, Jiayuan Li

AI总结:

本文提出CORE数据集和PLANET框架,用于解决全球跨模态地理定位问题,通过大规模数据和物理一致性学习提升定位的鲁棒性和全球适用性。

摘要:

跨模态地理定位(CMGL)将地面级文本描述与带有地理标签的航空影像匹配,这对于行人导航和应急响应至关重要。然而,现有研究受限于狭窄的地理覆盖和简单的场景多样性,无法反映全球建筑风格和地形特征的巨大空间异质性。为弥合这一差距并促进通用定位,我们引入CORE,首个专注于全球CMGL的百万级数据集。CORE包含来自六个大洲225个不同地理区域的1,034,786张跨视角图像,在多样的环境条件和城市布局中提供前所未有的视角多样性。我们利用大视觉-语言模型(LVLMs)的零样本推理能力来合成高质量的场景描述,富含判别性线索。此外,我们提出一个物理定律意识的网络(PLANET)用于跨模态地理定位。PLANET引入了一种新的对比学习范式,指导文本表示在捕捉卫星影像的内在物理特征方面发挥作用。在各种地理区域的广泛实验中,PLANET显著优于现有最先进方法,建立了新的基准,为稳健、大规模的地理定位奠定了基础。数据集和源代码将在https://github.com/YtH0823/CORE发布。

英文摘要:

Cross-modal Geo-localization (CMGL) matches ground-level text descriptions with geo-tagged aerial imagery, which is crucial for pedestrian navigation and emergency response. However, existing studies are constrained by narrow geographic coverage and simplistic scene diversity, failing to reflect the immense spatial heterogeneity of global architectural styles and topographic features. To bridge this gap and facilitate universal positioning, we introduce CORE, the first million-scale dataset dedicated to global CMGL. CORE comprises 1,034,786 cross-view images sampled from 225 distinct geographic regions across six continents, offering an unprecedented variety of perspectives in varying environmental conditions and urban layouts. We leverage the zero-shot reasoning of Large Vision-Language Models (LVLMs) to synthesize high-quality scene descriptions rich in discriminative cues. Furthermore, we propose a physical-law-aware network (PLANET) for cross-modal geo-localization. PLANET introduces a novel contrastive learning paradigm to guide textual representations in capturing the intrinsic physical signatures of satellite imagery. Extensive experiments across varied geographic regions demonstrate that PLANET significantly outperforms state-of-the-art methods, establishing a new benchmark for robust, global-scale geo-localization. The dataset and source code will be released at https://github.com/YtH0823/CORE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑