arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.04719eess.IV
收藏

用于高光谱解混的展开式即插即用网络

Unrolling Plug-and-Play Network for Hyperspectral Unmixing

Min Zhao, Linruize Tang, Jie Chen

AI总结:

针对深度学习解混可解释性不足、传统方法依赖人工正则化的问题,提出展开即插即用算法的深度网络,融合内外部先验并用动态卷积与注意力建模多尺度信息,实验性能优于对比方法。

摘要:

近年来,基于深度学习的解混方法受到广泛关注并取得了显著性能。这些方法采用数据驱动方式从高光谱图像中提取结构特征,但其物理可解释性往往较弱。传统解混方法具有更强的可解释性,却需要人工设计正则化并选择惩罚参数。为克服上述局限,我们提出一种新颖的解混方法,通过展开即插即用解混算法来构建深度架构。该方法融合了内部先验与外部先验:精心设计的展开深度架构用于学习高光谱图像中的光谱和空间信息,我们称之为内部先验;同时引入在大量图像数据上预训练的深度去噪器,以利用外部先验。其次,我们设计了动态卷积来建模多尺度信息,并通过注意力模块融合不同尺度。在合成数据集和真实数据集上的实验结果均表明,所提方法优于参与比较的方法。

英文摘要:

Deep learning based unmixing methods have received great attention in recent years and achieve remarkable performance. These methods employ a data-driven approach to extract structure features from hyperspectral image, however, they tend to be less physical interpretable. Conventional unmixing methods are with much more interpretability, whereas they require manually designing regularization and choosing penalty parameters. To overcome these limitations, we propose a novel unmixing method by unrolling the plug-and-play unmixing algorithm to conduct the deep architecture. Our method integrates both inner and outer priors. The carefully designed unfolding deep architecture is used to learn the spectral and spatial information from the hyperspectral image, which we refer to as inner priors. Additionally, our approach incorporates deep denoisers that have been pretrained on a large volume of image data to leverage the outer priors. Secondly, we design a dynamic convolution to model the multiscale information. Different scales are fused using an attention module. Experimental results of both synthetic and real datasets demonstrate that our method outperforms compared methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑