arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.02484cs.CVcs.AI

ERetinex:事件相机与Retinex理论结合用于低光照图像增强

ERetinex: Event Camera Meets Retinex Theory for Low-Light Image Enhancement

School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件学院);College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);School of Software, Tsinghua University(清华大学软件学院)

Xuejian Guo, Zhiqiang Tian, Yuehang Wang, Siqi Li, Yu Jiang, Shaoyi Du, Yue Gao

AI总结:

本文提出首个结合Retinex理论与事件相机的低光照图像恢复框架ERetinex,利用事件相机高时间分辨率数据准确估计光照,并融合其高动态范围数据与传统图像颜色信息,在提升PSNR 1.0613 dB的同时减少84.28%的FLOPS。

摘要:

低光照图像增强旨在恢复在黑暗场景中捕获的欠曝光图像。在这种场景下,由于曝光时间的限制,传统的基于帧的相机可能无法捕获结构和颜色信息。事件相机是生物启发的视觉传感器,异步响应像素级的亮度变化。事件相机的高动态范围对于极端低光照场景中的视觉感知至关重要,超越了传统相机,并使其能够在具有挑战性的黑暗环境中应用。本文受Retinex理论在传统基于帧低光照图像恢复中取得成功的启发,首次引入将Retinex理论与事件相机相结合的方法,并提出了一种基于Retinex理论的低光照图像恢复框架,命名为ERetinex。我们的首要贡献是开发了一种新方法,利用来自事件相机的高时间分辨率数据与传统图像信息,准确估计场景光照。该方法通过提供更精确的光照信息,优于仅使用传统图像的技术,尤其是在低光照环境中。此外,我们提出了一种有效的融合策略,将来自事件相机的高动态范围数据与传统图像的颜色信息相结合以增强图像质量。通过这种融合,我们能够生成更清晰、细节更丰富的图像,即使在极端光照条件下也能保持视觉信息的完整性。实验结果表明,我们提出的方法优于现有最先进(SOTA)方法,在PSNR上取得了1.0613 dB的提升,同时减少了84.28%的FLOPS。

英文摘要:

Low-light image enhancement aims to restore the under-exposure image captured in dark scenarios. Under such scenarios, traditional frame-based cameras may fail to capture the structure and color information due to the exposure time limitation. Event cameras are bio-inspired vision sensors that respond to pixel-wise brightness changes asynchronously. Event cameras' high dynamic range is pivotal for visual perception in extreme low-light scenarios, surpassing traditional cameras and enabling applications in challenging dark environments. In this paper, inspired by the success of the retinex theory for traditional frame-based low-light image restoration, we introduce the first methods that combine the retinex theory with event cameras and propose a novel retinex-based low-light image restoration framework named ERetinex. Among our contributions, the first is developing a new approach that leverages the high temporal resolution data from event cameras with traditional image information to estimate scene illumination accurately. This method outperforms traditional image-only techniques, especially in low-light environments, by providing more precise lighting information. Additionally, we propose an effective fusion strategy that combines the high dynamic range data from event cameras with the color information of traditional images to enhance image quality. Through this fusion, we can generate clearer and more detail-rich images, maintaining the integrity of visual information even under extreme lighting conditions. The experimental results indicate that our proposed method outperforms state-of-the-art (SOTA) methods, achieving a gain of 1.0613 dB in PSNR while reducing FLOPS by \textbf{84.28}\%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑