arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.16645cs.CV
收藏

互补优势:利用跨域频率相关性实现近红外辅助的图像去噪

Complementary Advantages: Exploiting Cross-Field Frequency Correlation for NIR-Assisted Image Denoising

School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息研究院)

Yuchen Wang, Hongyuan Wang, Lizhi Wang, Xin Wang, Lin Zhu, Wanxuan Lu, Hua Huang

AI总结:

针对近红外辅助RGB图像去噪中两域贡献难平衡的问题,提出基于频域互补相关先验的FCENet,通过频率动态选择与穷尽融合机制实现更优去噪效果。

摘要:

现有的单图像去噪算法在处理复杂噪声图像时往往难以恢复细节。近红外(NIR)图像的引入为RGB图像去噪提供了新的可能。然而,由于NIR图像与RGB图像之间存在不一致性,现有研究在图像融合过程中仍难以平衡两个域的贡献。针对这一问题,本文提出了一种用于NIR辅助图像去噪的跨域频率相关性挖掘网络(FCENet)。我们首先通过对NIR-RGB图像对进行深入的频率统计分析,提出了频率相关性先验。该先验揭示了NIR与RGB图像在频域中的互补相关性。基于频率相关性先验,我们进一步构建了由频率动态选择机制(FDSM)和频率穷尽融合机制(FEFM)组成的频率学习框架。FDSM在频域中从NIR和RGB图像中动态选择互补信息,FEFM则在NIR与RGB特征的融合过程中强化对共有特征和差异特征的管控。在模拟数据和真实数据上开展的大量实验验证了所提方法的性能优于其他现有最优方法。代码将发布于https://github.com/yuchenwang815/FCENet。

英文摘要:

Existing single-image denoising algorithms often struggle to restore details when dealing with complex noisy images. The introduction of near-infrared (NIR) images offers new possibilities for RGB image denoising. However, due to the inconsistency between NIR and RGB images, the existing works still struggle to balance the contributions of two fields in the process of image fusion. In response to this, in this paper, we develop a cross-field Frequency Correlation Exploiting Network (FCENet) for NIR-assisted image denoising. We first propose the frequency correlation prior based on an in-depth statistical frequency analysis of NIR-RGB image pairs. The prior reveals the complementary correlation of NIR and RGB images in the frequency domain. Leveraging frequency correlation prior, we then establish a frequency learning framework composed of Frequency Dynamic Selection Mechanism (FDSM) and Frequency Exhaustive Fusion Mechanism (FEFM). FDSM dynamically selects complementary information from NIR and RGB images in the frequency domain, and FEFM strengthens the control of common and differential features during the fusion process of NIR and RGB features. Extensive experiments on simulated and real data validate that the proposed method outperforms other state-of-the-art methods. The code will be released at https://github.com/yuchenwang815/FCENet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑