FourLLIE:利用傅里叶频率信息增强低光图像
FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Information
AI总结:
本文提出两阶段傅里叶低光增强网络FourLLIE,利用幅度与亮度正相关关系在傅里叶空间提升亮度,并结合SNR图融合全局频率与局部空间信息恢复细节,在四个数据集上超越SOTA方法且保持高效。
摘要:
近年来,傅里叶频率信息在低光图像增强(LLIE)中引起了广泛关注。一些研究者注意到,在傅里叶空间中,亮度退化主要存在于幅度分量中,其余部分存在于相位分量中。通过结合傅里叶频率和空间信息,这些研究者提出了出色的LLIE解决方案。在本工作中,我们进一步探索了幅度大小与亮度大小之间的正相关关系,这种关系可以被有效利用来在傅里叶空间中改善低光图像的亮度。此外,我们发现傅里叶变换可以提取图像的全局信息,并且不会像多层感知机(MLP)或Transformer那样引入大量神经网络参数。为此,我们提出了一种两阶段基于傅里叶的LLIE网络(FourLLIE)。在第一阶段,我们通过估计傅里叶空间中的幅度变换图来改善低光图像的亮度。在第二阶段,我们引入信噪比(SNR)图来提供先验,用于整合全局傅里叶频率和局部空间信息,从而在空间空间中恢复图像细节。凭借这一巧妙的设计,FourLLIE在四个代表性数据集上优于现有的最先进(SOTA)LLIE方法,同时保持了良好的模型效率。
英文摘要:
Recently, Fourier frequency information has attracted much attention in Low-Light Image Enhancement (LLIE). Some researchers noticed that, in the Fourier space, the lightness degradation mainly exists in the amplitude component and the rest exists in the phase component. By incorporating both the Fourier frequency and the spatial information, these researchers proposed remarkable solutions for LLIE. In this work, we further explore the positive correlation between the magnitude of amplitude and the magnitude of lightness, which can be effectively leveraged to improve the lightness of low-light images in the Fourier space. Moreover, we find that the Fourier transform can extract the global information of the image, and does not introduce massive neural network parameters like Multi-Layer Perceptrons (MLPs) or Transformer. To this end, a two-stage Fourier-based LLIE network (FourLLIE) is proposed. In the first stage, we improve the lightness of low-light images by estimating the amplitude transform map in the Fourier space. In the second stage, we introduce the Signal-to-Noise-Ratio (SNR) map to provide the prior for integrating the global Fourier frequency and the local spatial information, which recovers image details in the spatial space. With this ingenious design, FourLLIE outperforms the existing state-of-the-art (SOTA) LLIE methods on four representative datasets while maintaining good model efficiency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。