arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.14801cs.CV
收藏

ExReg:通过带有注意力机制的多维回归器实现宽范围照片曝光校正

ExReg: Wide-range Photo Exposure Correction via a Multi-dimensional Regressor with Attention

National Yang Ming Chiao Tung University

Huu-Phu Do, Hao-Chien Hsueh, Tzu-Hao Chiang, Chi-Han Chen, Wen-Hsiao Peng, Ching-Chun Huang

AI总结:

ExReg通过多维回归和注意力机制,解决宽范围照片曝光校正问题,实现高效且准确的曝光调整。

摘要:

照片曝光校正被广泛研究,但较少有研究同时校正欠曝光和过曝光图像。三个问题仍然需要解决,以在统一的方式中处理和校正欠曝光和过曝光图像。首先,局部自适应的曝光调整可能比学习全局映射更灵活。其次,确定合适的局部曝光值是一个病态问题。第三,内容相同但曝光不同的照片可能无法达到一致的调整结果。为此,我们提出了一种新的曝光校正网络ExReg,通过将曝光校正公式化为多维回归过程来解决这些挑战。给定一个输入图像,引入了一个紧凑的多曝光生成网络,用于生成具有不同曝光条件的图像,以进行多维回归和曝光校正。设计了一个辅助模块,用于预测区域级的曝光值,指导所提出的编码器-解码器ANP(注意力神经过程)回归最终校正的图像。实验结果表明,ExReg可以生成良好的曝光结果,并在PSNR方面优于最先进的方法,以解决广泛的曝光问题。此外,处理速度在RTX 3090上每张图像仅需0.05秒,效率高。当在不同曝光水平下测试同一图像时,ExReg也产生视觉一致且物理准确的结果。

英文摘要:

Photo exposure correction is widely investigated, but fewer studies focus on correcting under- and over-exposed images simultaneously. Three issues remain open to handle and correct both under- and over-exposed images in a unified way. First, a locally-adaptive exposure adjustment may be more flexible instead of learning a global mapping. Second, it is an ill-posed problem to determine the suitable exposure values locally. Third, photos with the same content but different exposures may not reach consistent adjustment results. To this end, we proposed a novel exposure correction network, ExReg, to address the challenges by formulating exposure correction as a multi-dimensional regression process. Given an input image, a compact multi-exposure generation network is introduced to generate images with different exposure conditions for multi-dimensional regression and exposure correction in the next stage. An auxiliary module is designed to predict the region-wise exposure values, guiding the proposed Encoder-Decoder ANP (Attentive Neural Processes) to regress the final corrected image. The experimental results show that ExReg can generate well-exposed results and outperform the SOTA method in PSNR for extensive exposure problems. Furthermore, the processing speed, with 0.05 seconds per image on an RTX 3090, is efficient. When tested on the same image under various exposure levels, ExReg also yields results that are visually consistent and physically accurate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑