arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.13628cs.CVcs.AI
收藏

基于可定位性的自适应推理图像地理定位方法

Locatability-Guided Adaptive Reasoning for Image Geo-Localization with Vision-Language Models

The University of Utah(犹他大学);The University of Oklahoma(俄克拉荷马大学);Worcester Polytechnic Institute(沃斯特理工学院);Rensselaer Polytechnic Institute(雷士利理工学院);University of Illinois Chicago(伊利诺伊大学芝加哥分校)

Bo Yu, Fengze Yang, Yiming Liu, Chao Wang, Xuewen Luo, Taozhe Li, Ruimin Ke, Xiaofan Zhou, Chenxi Liu

AI总结:

本文提出Geo-ADAPT框架,通过优化可定位性评分和两阶段分组相对策略优化,提升图像地理定位的适应性和准确性,减少幻觉。

摘要:

视觉-语言模型(VLMs)的出现为全球图像地理定位引入了通过检索增强生成(RAG)和推理驱动推断的新范式。然而,RAG方法受限于检索数据库质量,而推理驱动方法无法内部化图像可定位性,依赖低效固定深度推理路径,导致幻觉和精度下降。为克服这些限制,我们引入了优化的可定位性评分,量化图像在地理定位中的深度推理适配性。利用此指标,我们构建了增强推理轨迹的Geo-ADAPT-51K数据集。基于此基础,我们提出两阶段分组相对策略优化(GRPO)课程,采用定制奖励函数调节自适应推理深度、视觉接地和层级地理准确性。我们的框架Geo-ADAPT学习自适应推理策略,在多个地理定位基准上取得最佳性能,并通过自适应和高效推理显著减少幻觉。

英文摘要:

The emergence of Vision-Language Models (VLMs) has introduced new paradigms for global image geo-localization through retrieval-augmented generation (RAG) and reasoning-driven inference. However, RAG methods are constrained by retrieval database quality, while reasoning-driven approaches fail to internalize image locatability, relying on inefficient, fixed-depth reasoning paths that increase hallucinations and degrade accuracy. To overcome these limitations, we introduce an Optimized Locatability Score that quantifies an image's suitability for deep reasoning in geo-localization. Using this metric, we curate Geo-ADAPT-51K, a locatability-stratified reasoning dataset enriched with augmented reasoning trajectories for complex visual scenes. Building on this foundation, we propose a two-stage Group Relative Policy Optimization (GRPO) curriculum with customized reward functions that regulate adaptive reasoning depth, visual grounding, and hierarchical geographical accuracy. Our framework, Geo-ADAPT, learns an adaptive reasoning policy, achieves state-of-the-art performance across multiple geo-localization benchmarks, and substantially reduces hallucinations by reasoning both adaptively and efficiently.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑