arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.09650cs.CVcs.AIcs.MMeess.IV
收藏

从黑暗到细节:面向低光视觉的频率感知SSM

From Darkness to Detail: Frequency-Aware SSMs for Low-Light Vision

Lehigh University(莱特大学);Lenovo Research(联想研究院)

Eashan Adhikarla, Kai Zhang, Gong Chen, John Nicholson, Brian D. Davison

AI总结:

ExpoMamba通过频率感知状态空间模型解决低光图像增强中的混合曝光问题,实现高效高质量的实时增强。

摘要:

低光图像增强仍然是计算机视觉领域持续存在的挑战,其中最先进的模型往往受到硬件限制和计算效率的阻碍,特别是在高分辨率情况下。尽管基础架构如Transformer和扩散模型推动了该领域的发展,但其计算复杂性限制了它们在边缘设备上的部署。我们引入了ExpoMamba,一种新的架构,它在修改后的U-Net中集成了一个频率感知的状态空间模型。ExpoMamba旨在通过在频率域中解耦幅度(强度)和相位(结构)的建模来解决混合曝光挑战。这使得能够有针对性的增强,使其在实时应用中非常有效,包括下游任务如目标检测和分割。我们在六个基准数据集上的实验表明,ExpoMamba比竞争模型快2-3倍,并实现了6.8%的PSNR提升,建立了高效高质量低光增强的新状态。源代码:https://www.github.com/eashanadhikarla/ExpoMamba。

英文摘要:

Low-light image enhancement remains a persistent challenge in computer vision, where state-of-the-art models are often hampered by hardware constraints and computational inefficiency, particularly at high resolutions. While foundational architectures like transformers and diffusion models have advanced the field, their computational complexity limits their deployment on edge devices. We introduce ExpoMamba, a novel architecture that integrates a frequency-aware state-space model within a modified U-Net. ExpoMamba is designed to address mixed-exposure challenges by decoupling the modeling of amplitude (intensity) and phase (structure) in the frequency domain. This allows for targeted enhancement, making it highly effective for real-time applications, including downstream tasks like object detection and segmentation. Our experiments on six benchmark datasets show that ExpoMamba is up to 2-3x faster than competing models and achieves a 6.8\% PSNR improvement, establishing a new state-of-the-art in efficient, high-quality low-light enhancement. Source code: https://www.github.com/eashanadhikarla/ExpoMamba.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑