arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.15652cs.CV

迈向现实的开放词汇遥感分割:基准与基线

Perturbation-Regularized Open-Vocabulary Remote Sensing Segmentation with Unified Multi-Domain Evaluation

Department of Electronic Engineering and Information Science, University of Science and Technology of China(电子工程与信息科学系,中国科学技术大学);School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University(人工智能学院,光学与电子学系(iOPEN),西北工业大学);Institute of Artificial Intelligence (TeleAI), China Telecom, P. R. China(人工智能研究院(TeleAI),中国电信,中华人民共和国)

Bingyu Li, Tao Huo, Haocheng Dong, Da Zhang, Zhiyuan Zhao, Junyu Gao, Xuelong Li

AI总结:

本文提出OVRSISBenchV2基准和Pi-Seg基线,通过构建大规模数据集和下游任务协议,提升遥感开放词汇分割的现实应用能力。

摘要:

开放词汇遥感图像分割(OVRSIS)因碎片化数据集、训练多样性不足和缺乏反映真实地理空间应用需求的评估基准而未被充分研究。我们的先前OVRSISBenchV1建立了初步的跨数据集评估协议,但其范围有限,无法评估现实中的开放世界泛化能力。为解决此问题,我们提出了OVRSISBenchV2,一个大规模且应用导向的OVRSIS基准。我们首先构建了OVRSIS95K,一个包含约95,000个图像-掩码对的平衡数据集,覆盖35种常见语义类别,涵盖多样化的遥感场景。基于OVRSIS95K和10个下游数据集,OVRSISBenchV2包含170,000张图像和128个类别,大幅扩展了场景多样性、语义覆盖和评估难度。除了标准的开放词汇分割,它还进一步包括构建提取、道路提取和洪水检测等下游协议,从而更好地反映真实地理空间应用需求和复杂部署场景。我们还提出了Pi-Seg,一个OVRSIS的基线。Pi-Seg通过正向激励噪声机制提升迁移能力,其中可学习且语义引导的扰动在训练过程中扩展视觉-文本特征空间。在OVRSISBenchV1、OVRSISBenchV2和下游任务上的大量实验表明,Pi-Seg在OVRSISBenchV2基准上表现尤为突出。我们的结果突显了现实基准设计的重要性和基于扰动的迁移效果。代码和数据集可在https://github.com/LiBingyu01/RSKT-Seg/tree/Pi-Seg获取。

英文摘要:

Open-vocabulary remote sensing image segmentation (OVRSIS) aims to segment text-specified categories beyond a fixed label space. Its key challenge is to maintain reliable pixel--text correspondence under substantial appearance variation in remote-sensing imagery. Existing methods often rely on specialized vision--language representations or complex adaptation mechanisms, yet still perform deterministic matching between fixed text prototypes and individual visual features. We instead formulate OVRSIS as a \emph{distributional pixel--text alignment} problem and propose \textbf{Pi-Seg}, a lightweight perturbation-based framework. Pi-Seg introduces learnable variations into textual prototypes and dense visual features before alignment. Segmentation supervision encourages perturbations that enlarge the target-to-distractor margin while suppressing harmful feature shifts. Pi-Seg consistently improves performance under the existing \textit{single-source} OVRSISBench protocols. To evaluate OVRSIS beyond source-specific training settings, we further introduce a unified \textit{multi-source} protocol and construct \textbf{GlobalRSOV95K}, containing approximately 95K densely annotated images and 35 semantic categories. Models are trained on this shared dataset and evaluated on an image-disjoint suite of 10 downstream datasets. The complete benchmark covers more than 170K images and 122 categories. Experiments under both single-source and multi-source protocols show that Pi-Seg improves cross-dataset transfer and generalizes effectively to practical geospatial segmentation tasks, while GlobalRSOV95K provides a common foundation for transferable OVRSIS research. \footnote{\url{https://github.com/LiBingyu01/Pi-Seg}}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑