arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.03490cs.CVcs.AI

CroBIM-U: 基于不确定性的遥感图像分割

CroBIM-U: Uncertainty-Driven Referring Remote Sensing Image Segmentation

School of Electronics and Information Engineering, Harbin Institute of Technology(电子与信息工程学院,哈尔滨工业大学)

Yuzhe Sun, Zhe Dong, Haochen Jiang, Tianzhu Liu, Yanfeng Gu

AI总结:

CroBIM-U通过不确定性引导框架提升遥感图像分割的鲁棒性和几何精度,采用不确定性图和即插即用模块实现自适应推理与局部细化。

摘要:

参考遥感图像分割旨在定位由自然语言描述的特定目标,以在复杂的高空影像中实现精准定位。然而,由于极端的尺度变化、密集的相似干扰物以及复杂的边界结构,跨模态对齐的可靠性表现出显著的空间非均匀性。现有方法通常在整张图像上采用统一的融合和细化策略,这在视觉清晰区域往往引入不必要的语言扰动,而在困惑区域未能提供足够的歧义消除。为此,我们提出了一种基于不确定性的框架,该框架明确利用像素级的参考不确定性图作为空间先验,以协调自适应推断。具体而言,我们引入了一个即插即用的参考不确定性评分器(RUS),该评分器通过在线误差一致性监督策略进行训练,以可解释的方式预测参考模糊性的空间分布。在此先验基础上,我们设计了两个即插即用模块:1)不确定性门控融合(UGF),它动态调节语言注入强度,以增强高不确定性区域的约束,同时抑制低不确定性区域的噪声;2)基于不确定性的局部细化(UDLR),它利用不确定性衍生的软掩码,将细化聚焦在易出错的边界和细节上。广泛的实验表明,我们的方法作为一种统一、即插即用的解决方案,在复杂遥感场景中显著提高了鲁棒性和几何保真度,而无需改变骨干网络架构。

英文摘要:

Referring remote sensing image segmentation aims to localize specific targets described by natural language within complex overhead imagery. However, due to extreme scale variations, dense similar distractors, and intricate boundary structures, the reliability of cross-modal alignment exhibits significant \textbf{spatial non-uniformity}. Existing methods typically employ uniform fusion and refinement strategies across the entire image, which often introduces unnecessary linguistic perturbations in visually clear regions while failing to provide sufficient disambiguation in confused areas. To address this, we propose an \textbf{uncertainty-guided framework} that explicitly leverages a pixel-wise \textbf{referring uncertainty map} as a spatial prior to orchestrate adaptive inference. Specifically, we introduce a plug-and-play \textbf{Referring Uncertainty Scorer (RUS)}, which is trained via an online error-consistency supervision strategy to interpretably predict the spatial distribution of referential ambiguity. Building on this prior, we design two plug-and-play modules: 1) \textbf{Uncertainty-Gated Fusion (UGF)}, which dynamically modulates language injection strength to enhance constraints in high-uncertainty regions while suppressing noise in low-uncertainty ones; and 2) \textbf{Uncertainty-Driven Local Refinement (UDLR)}, which utilizes uncertainty-derived soft masks to focus refinement on error-prone boundaries and fine details. Extensive experiments demonstrate that our method functions as a unified, plug-and-play solution that significantly improves robustness and geometric fidelity in complex remote sensing scenes without altering the backbone architecture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑