arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.06002cs.CV
收藏

基于多尺度人脸先验信息渐进嵌入的人脸超分辨率

Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors

Tianjin University(天津大学);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)

Chenggong Zhang, Zhilei Liu

摘要:

人脸超分辨率(FSR)任务是从低分辨率输入重建高分辨率人脸图像。最近的工作已经取得了成功,这项任务,利用面部先验,如面部标志。现有的方法大多关注全局形状和结构信息,而对局部纹理信息关注较少,不能很好地恢复局部细节。在本文中,我们提出了一种新的基于递归卷积网络的人脸超分辨率框架,逐步引入全局形状和局部纹理信息。我们充分利用递归网络的中间输出,在第一步和第二步的输出中分别提取地标信息和面部动作单元(AU)信息,而不是低分辨率的输入。此外,我们引入了AU分类结果作为一种新的定量度量的面部细节恢复。大量的实验表明,我们提出的方法显着优于国家的最先进的FSR方法在图像质量和面部细节恢复。

英文摘要:

The face super-resolution (FSR) task is to reconstruct high-resolution face images from low-resolution inputs. Recent works have achieved success on this task by utilizing facial priors such as facial landmarks. Most existing methods pay more attention to global shape and structure information, but less to local texture information, which makes them cannot recover local details well. In this paper, we propose a novel recurrent convolutional network based framework for face super-resolution, which progressively introduces both global shape and local texture information. We take full advantage of the intermediate outputs of the recurrent network, and landmarks information and facial action units (AUs) information are extracted in the output of the first and second steps respectively, rather than low-resolution input. Moreover, we introduced AU classification results as a novel quantitative metric for facial details restoration. Extensive experiments show that our proposed method significantly outperforms state-of-the-art FSR methods in terms of image quality and facial details restoration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑