arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.21634cs.CV

RSGround-R1: 重新思考通过空间推理的遥感视觉定位

RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning

School of Electrical and Electronic Engineering, Nanyang Technological University(电气电子工程学院,南洋理工大学);MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics(教育部计算与经济交叉学科重点实验室,上海财经大学)

Shiqi Huang, Shuting He, Bihan Wen

AI总结:

RSGround-R1通过引入空间推理引导的后训练框架,提升遥感图像中目标物体的定位精度与鲁棒性。

摘要:

遥感视觉定位(RSVG)旨在基于自然语言描述在大规模航空图像中定位目标物体。由于遥感场景的广阔空间尺度和高语义模糊性,这些描述往往依赖于位置线索,这对多模态大语言模型(MLLMs)在空间推理中的挑战具有独特性。为了利用这一独特特征,我们提出了一种推理引导、位置感知的后训练框架,称为RSGround-R1,以逐步增强空间理解。具体而言,我们首先引入链式思维监督微调(CoT-SFT),使用合成生成的RSVG推理数据建立显式的位置意识。然后应用强化微调(RFT),并辅以我们新设计的位置奖励,提供连续的距离感知指导以实现准确的定位。此外,为了缓解跨rollout中的不一致定位行为,我们引入了空间一致性引导的优化方案,该方案根据策略更新的空间一致性动态调整,确保稳定且稳健的收敛。在RSVG基准上的大量实验表明,我们的模型表现出色且具有良好的泛化能力。

英文摘要:

Remote Sensing Visual Grounding (RSVG) aims to localize target objects in large-scale aerial imagery based on natural language descriptions. Owing to the vast spatial scale and high semantic ambiguity of remote sensing scenes, these descriptions often rely heavily on positional cues, posing unique challenges for Multimodal Large Language Models (MLLMs) in spatial reasoning. To leverage this unique feature, we propose a reasoning-guided, position-aware post-training framework, dubbed \textbf{RSGround-R1}, to progressively enhance spatial understanding. Specifically, we first introduce Chain-of-Thought Supervised Fine-Tuning (CoT-SFT) using synthetically generated RSVG reasoning data to establish explicit position awareness. Reinforcement Fine-Tuning (RFT) is then applied, augmented by our newly designed positional reward that provides continuous and distance-aware guidance toward accurate localization. Moreover, to mitigate incoherent localization behaviors across rollouts, we introduce a spatial consistency guided optimization scheme that dynamically adjusts policy updates based on their spatial coherence, ensuring stable and robust convergence. Extensive experiments on RSVG benchmarks demonstrate superior performance and generalization of our model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑