arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.01276cs.CV
收藏

Wave-Mamba:面向超高清低光图像增强的小波状态空间模型

Wave-Mamba: Wavelet State Space Model for Ultra-High-Definition Low-Light Image Enhancement

South China University of Technology(华南理工大学);PAZHOU LAB(琶洲实验室)

Wenbin Zou, Hongxia Gao, Weipeng Yang, Tongtong Liu

AI总结:

本文提出Wave-Mamba,利用小波变换分离高低频信息,通过低频状态空间块和高频增强块实现超高清低光图像增强,在保持精简架构的同时显著超越现有方法。

摘要:

超高清(UHD)技术因其卓越的视觉质量而受到广泛关注,但同时也给低光图像增强(LLIE)技术带来了新的挑战。UHD图像本身具有很高的计算复杂度,导致现有的UHD LLIE方法采用高倍率下采样来降低计算成本,这反过来又造成了信息损失。小波变换不仅能够在不损失信息的情况下实现下采样,还能将图像内容与噪声分离开来。它使状态空间模型(SSMs)在对长序列建模时能够避免受到噪声的影响,从而充分利用SSMs的长序列建模能力。在此基础上,我们提出了Wave-Mamba,这是一种基于小波域中两个关键观察的新方法:1)图像的大部分内容信息存在于低频分量中,高频分量中较少。2)高频分量对低光增强结果的影响极小。具体而言,为了高效地对UHD图像上的全局内容信息进行建模,我们提出了低频状态空间块(LFSSBlock),通过改进SSMs使其专注于恢复低频子带的信息。此外,我们针对高频子带信息提出了高频增强块(HFEBlock),利用增强后的低频信息来校正高频信息,并有效恢复正确的高频细节。通过全面评估,我们的方法展现了优越的性能,在保持更精简架构的同时,显著超越了当前领先的技术。代码可在 https://github.com/AlexZou14/Wave-Mamba 获取。

英文摘要:

Ultra-high-definition (UHD) technology has attracted widespread attention due to its exceptional visual quality, but it also poses new challenges for low-light image enhancement (LLIE) techniques. UHD images inherently possess high computational complexity, leading existing UHD LLIE methods to employ high-magnification downsampling to reduce computational costs, which in turn results in information loss. The wavelet transform not only allows downsampling without loss of information, but also separates the image content from the noise. It enables state space models (SSMs) to avoid being affected by noise when modeling long sequences, thus making full use of the long-sequence modeling capability of SSMs. On this basis, we propose Wave-Mamba, a novel approach based on two pivotal insights derived from the wavelet domain: 1) most of the content information of an image exists in the low-frequency component, less in the high-frequency component. 2) The high-frequency component exerts a minimal influence on the outcomes of low-light enhancement. Specifically, to efficiently model global content information on UHD images, we proposed a low-frequency state space block (LFSSBlock) by improving SSMs to focus on restoring the information of low-frequency sub-bands. Moreover, we propose a high-frequency enhance block (HFEBlock) for high-frequency sub-band information, which uses the enhanced low-frequency information to correct the high-frequency information and effectively restore the correct high-frequency details. Through comprehensive evaluation, our method has demonstrated superior performance, significantly outshining current leading techniques while maintaining a more streamlined architecture. The code is available at https://github.com/AlexZou14/Wave-Mamba.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑