arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.03499eess.IVcs.CV

GeoDiff-SAR:一种基于几何先验的扩散模型用于SAR图像生成

GeoDiff-SAR: A Geometric Prior Guided Diffusion Model for SAR Image Generation

College of Information Science and Technology, Beijing University of Chemical Technology(信息科学与技术学院,北京化工大学);Aerospace Information Research Institute, Chinese Academy of Sciences(航天信息研究所,中国科学院)

Fan Zhang, Xuanting Wu, Fei Ma, Qiang Yin, Yuxin Hu

AI总结:

GeoDiff-SAR通过引入几何先验引导扩散模型,提升SAR图像生成的保真度和分类准确性,尤其在不同方位角识别性能上有显著提升。

摘要:

合成孔径雷达(SAR)成像结果对观测几何和目标的几何参数高度敏感。然而,现有生成方法主要在图像域内操作,忽略了显式的几何信息。这一限制常导致生成质量不理想,并无法精确控制关键参数如方位角。为解决这些挑战,我们提出了GeoDiff-SAR,一种用于高保真SAR图像生成的几何先验引导扩散模型。具体而言,GeoDiff-SAR首先通过在特定方位角计算SAR点云,高效模拟现实SAR成像中固有的几何结构和散射关系,这为稳健的物理指导提供了基础。其次,为了有效融合多模态信息,我们采用基于特征-wise线性调制(FiLM)的特征融合门控网络,动态调节3D物理信息、图像控制参数和文本描述参数的权重分布。第三,我们利用低秩适应(LoRA)架构对先进的Stable Diffusion 3.5(SD3.5)模型进行轻量级微调,使其能够快速适应SAR域的分布特征。为了验证GeoDiff-SAR的有效性,我们在真实世界SAR数据集上进行了广泛的对比实验。结果表明,由GeoDiff-SAR生成的数据具有高保真度,并有效提升了下游分类任务的准确性。特别是,它在不同方位角上显著提高了识别性能,从而突显了物理引导生成的优越性。

英文摘要:

Synthetic aperture radar (SAR) image generation can mitigate data scarcity, but controllablegeneration under sparse observation angles remains difficult. Recent SAR generative studies im-prove texture realism, yet explicit geometry-aware control is still limited. This paper studiesthe focused and verifiable setting of intermediate-azimuth completion: 3D-model-derived geo-metric priors guide a diffusion model to synthesize the views missing from sparse-angle trainingdata. GeoDiff-SAR constructs a lightweight multi-bounce ray-tracing prior, encodes the result-ing point cloud, and fuses it with text conditioning while adapting Stable Diffusion 3.5 Mediumthrough low-rank adaptation. On a real four-category aircraft dataset, GeoDiff-SAR reaches anSSIM of 0.812 and azimuth consistency of 0.940, compared with 0.738 and 0.782 for the text-conditioned SD3.5 Medium baseline. The same sparse-angle protocol on five MSTAR vehicleclasses yields an SSIM of 0.878 and azimuth consistency of 0.917. These results support theconclusion that a lightweight 3D geometric prior improves viewpoint adherence for controllableSAR generation; it is intended as generation guidance rather than high-fidelity electromagneticreconstruction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑