arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2611.06105cs.CV
收藏

玄剑-DINOSAR:基于全局与局部语义一致性的SAR基础模型

XuanJian-DINOSAR: A SAR Foundation Model Based on Global and Local Semantic Consistency

Nanjing Institute of Electronic Technology(南京电子技术研究所);National Key Laboratory of Radar Detection and Sensing(雷达探测与感知全国重点实验室)

Chunxiao Wu, Huixin Huang, Jialei Pan, Qiang Liang, Tao Wu, Cheng Wu, Long Huang, Yuanji Li, Qiang Cheng, Aifang Liu, Linghao Xia, Rui Zhang

AI总结:

该研究提出基于全局与局部语义一致性的XuanJian-DINOSAR SAR基础模型,适配DINOv2并结合多模块设计,在多下游任务上实现最优性能,验证了表征的通用性与可迁移性。

摘要:

合成孔径雷达(SAR)图像的自监督预训练可生成可迁移的表征,但光学-SAR域差距与散斑扰动会限制表征稳定性。多数SAR基础模型通过像素重建或结构特征预测采用掩码图像建模(MIM),该方法对散斑敏感或依赖预定义算子,而对应空间位置的跨视图语义与扰动稳定性的联合建模仍未得到充分探索。本文提出XuanJian-DINOSAR,一种基于全局与局部语义一致性的SAR基础模型。我们整理了超过36万张公开的SAR目标芯片、检测图像和场景图像,涵盖不同目标、场景与传感器,并通过自监督学习将光学预训练的DINOv2模型适配至SAR。该框架结合DINO全局语义自蒸馏、iBOT局部掩码建模与KoLeo特征分布正则化,以学习具有全局判别性与局部结构感知的表征。我们引入了适配SAR强度统计与相干成像特性的局部语义一致性分支:共享几何变换生成空间对齐的教师弱视图与学生强视图,对学生视图应用强度变换与Gamma乘性散斑扰动,同时采用余弦一致性损失对齐对应位置的patch token,以提升辐射扰动下的稳定性。该目标补充了DINOv2多裁剪训练的跨区域与跨尺度语义一致性,共同强化全局与局部语义一致性。在多个下游分类与检测数据集上的实验表明,该模型在多数评估指标上实现了最优性能,验证了所学表征的通用性与可迁移性。

英文摘要:

Self-supervised pre-training on synthetic aperture radar (SAR) imagery enables transferable representations, but the optical-SAR domain gap and speckle perturbations limit representation stability. Most SAR foundation models use masked image modeling (MIM) through pixel reconstruction or structural feature prediction, which is sensitive to speckle or relies on predefined operators. Joint modeling of cross-view semantics and perturbation stability at corresponding spatial locations remains underexplored. We propose XuanJian-DINOSAR, a SAR foundation model based on global and local semantic consistency. We curate over 360K publicly available SAR target chips, detection images, and scene images spanning diverse targets, scenes, and sensors, and adapt an optically pre-trained DINOv2 model to SAR through self-supervised learning. The framework combines DINO global semantic self-distillation, iBOT local masked modeling, and KoLeo feature-distribution regularization to learn globally discriminative and locally structure-aware representations. We introduce a local semantic consistency branch tailored to SAR intensity statistics and coherent imaging characteristics. Shared geometric transformations produce spatially aligned teacher weak views and student strong views. Intensity transformations and Gamma multiplicative speckle perturbations are applied to student views, while a cosine consistency loss aligns patch tokens at corresponding locations, promoting stability under radiometric perturbations. This objective complements the cross-region and cross-scale semantic consistency of DINOv2 multi-crop training, jointly enforcing global and local semantic consistency. Experiments on multiple downstream classification and detection datasets demonstrate state-of-the-art performance on most evaluation metrics, validating the generality and transferability of the learned representations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑