arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.01354cs.CV
收藏

深度白平衡编辑

Deep White-Balance Editing

Samsung AI Center (SAIC) – Toronto(三星人工智能中心(SAIC)——多伦多);York University(约克大学)

Mahmoud Afifi, Michael S. Brown

摘要:

我们引入了一种深度学习方法来逼真地编辑sRGB图像的白平衡。摄像机捕获传感器图像,这些图像由其集成信号处理器(ISP)渲染为标准RGB(sRGB)颜色空间编码。ISP渲染从白平衡过程开始,该过程用于消除场景照明的色偏。然后,ISP应用一系列非线性颜色操作来增强最终sRGB图像的视觉质量。[3]最近的工作表明,由于ISP的非线性渲染,使用不正确的白平衡渲染的sRGB图像无法轻松校正。[3]中的工作提出了一种基于数万个图像对的k-最近邻(KNN)解决方案。我们建议使用深度神经网络(DNN)架构来解决这个问题,该架构以端到端的方式进行训练,以学习正确的白平衡。我们的DNN将输入图像映射到与室内和室外照明相对应的两个额外的白平衡设置。我们的解决方案不仅在纠正错误的白平衡设置方面比KNN方法更准确,而且还为用户提供了将sRGB图像中的白平衡编辑为其他照明设置的自由。

英文摘要:

We introduce a deep learning approach to realistically edit an sRGB image's white balance. Cameras capture sensor images that are rendered by their integrated signal processor (ISP) to a standard RGB (sRGB) color space encoding. The ISP rendering begins with a white-balance procedure that is used to remove the color cast of the scene's illumination. The ISP then applies a series of nonlinear color manipulations to enhance the visual quality of the final sRGB image. Recent work by [3] showed that sRGB images that were rendered with the incorrect white balance cannot be easily corrected due to the ISP's nonlinear rendering. The work in [3] proposed a k-nearest neighbor (KNN) solution based on tens of thousands of image pairs. We propose to solve this problem with a deep neural network (DNN) architecture trained in an end-to-end manner to learn the correct white balance. Our DNN maps an input image to two additional white-balance settings corresponding to indoor and outdoor illuminations. Our solution not only is more accurate than the KNN approach in terms of correcting a wrong white-balance setting but also provides the user the freedom to edit the white balance in the sRGB image to other illumination settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑