arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.09147cs.CV

Cosmetic-Aware Makeup Cleanser

CRIPAC, National Laboratory of Pattern Recognition, CASIA(中国科学院自动化研究所模式识别国家重点实验室CRIPAC);Center for Excellence in Brain Science and Intelligence Technology, CAS(中国科学院脑科学与智能技术卓越创新中心);University of Chinese Academy of Sciences(中国科学院大学)

Yi Li, Huaibo Huang, Junchi Yu, Ran He, Tieniu Tan

英文摘要:

Face verification aims at determining whether a pair of face images belongs to the same identity. Recent studies have revealed the negative impact of facial makeup on the verification performance. With the rapid development of deep generative models, this paper proposes a semanticaware makeup cleanser (SAMC) to remove facial makeup under different poses and expressions and achieve verification via generation. The intuition lies in the fact that makeup is a combined effect of multiple cosmetics and tailored treatments should be imposed on different cosmetic regions. To this end, we present both unsupervised and supervised semantic-aware learning strategies in SAMC. At image level, an unsupervised attention module is jointly learned with the generator to locate cosmetic regions and estimate the degree. At feature level, we resort to the effort of face parsing merely in training phase and design a localized texture loss to serve complements and pursue superior synthetic quality. The experimental results on four makeuprelated datasets verify that SAMC not only produces appealing de-makeup outputs at a resolution of 256*256, but also facilitates makeup-invariant face verification through image generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑