arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.12253cs.CV

DisCO:使用透视感知 3D GAN 进行人像畸变校正

DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANs

The University of Tokyo(东京大学);National Institute of Informatics(国立信息学研究所);National Yang Ming Chiao Tung University(国立阳明交通大学);University of Maryland, College Park(马里兰大学帕克分校);Snap Inc.(Snap公司)

Zhixiang Wang, Yu-Lun Liu, Jia-Bin Huang, Shin'ichi Satoh, Sizhuo Ma, Gurunandan Krishnan, Jian Wang

AI总结:

针对近距离特写入脸的透视畸变问题,本文提出 DisCO,通过透视感知 3D GAN inversion 联合优化相机参数与潜码,并引入调度和几何正则化,实现自然的人像校正。

摘要:

在短距离拍摄的特写人脸图像通常会受到透视畸变的影响,导致面部特征被夸大,并呈现不自然或不美观的外观。我们提出了一种简单而有效的方法,用于校正单张特写入脸中的透视畸变。我们首先利用发生透视畸变的输入人脸图像执行 GAN inversion,通过联合优化相机内参/外参和人脸潜码来实现。为解决联合优化的模糊性,我们开发了从短距离开始、优化调度、重参数化以及几何正则化等策略。在合适的焦距和相机距离下重新渲染人像,可有效校正透视畸变,并产生看起来更自然的结果。实验表明,我们的方法在定性和定量方面均优于以往方法。我们展示了大量示例,验证了该方法在 in-the-wild 人像照片上的适用性。我们将发布代码和评估协议,以促进未来研究。

英文摘要:

Close-up facial images captured at short distances often suffer from perspective distortion, resulting in exaggerated facial features and unnatural/unattractive appearances. We propose a simple yet effective method for correcting perspective distortions in a single close-up face. We first perform GAN inversion using a perspective-distorted input facial image by jointly optimizing the camera intrinsic/extrinsic parameters and face latent code. To address the ambiguity of joint optimization, we develop starting from a short distance, optimization scheduling, reparametrizations, and geometric regularization. Re-rendering the portrait at a proper focal length and camera distance effectively corrects perspective distortions and produces more natural-looking results. Our experiments show that our method compares favorably against previous approaches qualitatively and quantitatively. We showcase numerous examples validating the applicability of our method on in-the-wild portrait photos. We will release our code and the evaluation protocol to facilitate future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑