arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.06302cs.CV
收藏

利用大规模合成数据实现高质量高光去除

Towards High-Quality Specular Highlight Removal by Leveraging Large-Scale Synthetic Data

The Hong Kong Polytechnic University(香港理工大学);Sun Yat-sen University(中山大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Wuhan University(武汉大学)

Gang Fu, Qing Zhang, Lei Zhu, Chunxia Xiao, Ping Li

AI总结:

本文提出一种三阶段网络,通过分解、细化和色调调整去除单张图像高光,并构建大规模合成数据集,在真实物体级和场景级图像上均取得良好泛化效果。

摘要:

本文旨在从单张物体级图像中去除高光。尽管先前的方法取得了一些进展,但其性能仍然有限,特别是对于具有复杂高光的真实图像。为此,我们提出了一种三阶段网络来解决这些问题。具体而言,给定一张输入图像,我们首先将其分解为反照率、着色和高光残差分量,以估计粗略的无高光图像。然后,我们进一步细化粗略结果,以减轻其视觉伪影(如颜色失真)。最后,我们调整细化结果的色调,使其尽可能匹配输入图像的色调。此外,为了促进网络训练和定量评估,我们提供了一个大规模的物体级图像合成数据集,涵盖多样的物体和光照条件。大量实验表明,我们的网络能够很好地泛化到未见过的真实物体级图像,甚至对于具有多个背景物体和复杂光照的场景级图像也能产生良好的结果。

英文摘要:

This paper aims to remove specular highlights from a single object-level image. Although previous methods have made some progresses, their performance remains somewhat limited, particularly for real images with complex specular highlights. To this end, we propose a three-stage network to address them. Specifically, given an input image, we first decompose it into the albedo, shading, and specular residue components to estimate a coarse specular-free image. Then, we further refine the coarse result to alleviate its visual artifacts such as color distortion. Finally, we adjust the tone of the refined result to match that of the input as closely as possible. In addition, to facilitate network training and quantitative evaluation, we present a large-scale synthetic dataset of object-level images, covering diverse objects and illumination conditions. Extensive experiments illustrate that our network is able to generalize well to unseen real object-level images, and even produce good results for scene-level images with multiple background objects and complex lighting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑