arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.08759cs.CV
收藏

4K分辨率照片曝光校正:约8K参数下达到125 FPS

4K-Resolution Photo Exposure Correction at 125 FPS with ~8K Parameters

Nankai University(南开大学);Tianjin University(天津大学);Lappeenranta-Lahti University of Technology(拉彭兰塔-拉赫蒂理工大学);Guangdong Provincial Key Laboratory of Big Data Computing, CUHK (Shenzhen)(广东省大数据计算重点实验室,香港中文大学(深圳))

Yijie Zhou, Chao Li, Jin Liang, Tianyi Xu, Xin Liu, Jun Xu

AI总结:

提出仅约8K参数的极轻量多尺度线性变换网络,通过拉普拉斯金字塔分解和像素自适应线性变换,在Titan RTX上实现4K图像125 FPS的曝光校正,性能优于现有方法。

摘要:

不当曝光照片的照明问题已广泛使用深度卷积神经网络或Transformer进行校正。尽管这些方法性能优异,但在高分辨率照片上通常面临参数量大和计算FLOPs高的问题。本文提出在多层感知器架构下的极轻量级(仅约8K参数)多尺度线性变换(MSLT)网络,该网络可在Titan RTX GPU上以每秒125帧(FPS)处理4K分辨率sRGB图像。具体而言,所提出的MSLT网络首先通过拉普拉斯金字塔技术将输入图像分解为高频和低频层,然后通过像素自适应线性变换(由高效双边网格学习或1x1卷积实现)依次校正不同层。在两个基准数据集上的实验表明,我们的MSLT在照片曝光校正方面相对于现有最先进方法具有高效性。广泛的消融研究验证了我们贡献的有效性。代码可在https://github.com/Zhou-Yijie/MSLTNet获取。

英文摘要:

The illumination of improperly exposed photographs has been widely corrected using deep convolutional neural networks or Transformers. Despite with promising performance, these methods usually suffer from large parameter amounts and heavy computational FLOPs on high-resolution photographs. In this paper, we propose extremely light-weight (with only ~8K parameters) Multi-Scale Linear Transformation (MSLT) networks under the multi-layer perception architecture, which can process 4K-resolution sRGB images at 125 Frame-Per-Second (FPS) by a Titan RTX GPU. Specifically, the proposed MSLT networks first decompose an input image into high and low frequency layers by Laplacian pyramid techniques, and then sequentially correct different layers by pixel-adaptive linear transformation, which is implemented by efficient bilateral grid learning or 1x1 convolutions. Experiments on two benchmark datasets demonstrate the efficiency of our MSLTs against the state-of-the-arts on photo exposure correction. Extensive ablation studies validate the effectiveness of our contributions. The code is available at https://github.com/Zhou-Yijie/MSLTNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑