arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.11896cs.CVcs.LG
收藏

人脸图像的可重复性控制

Controlling Memorability of Face Images

University of Western Ontario(西安大略大学)

Mohammad Younesi, Yalda Mohsenzadeh

摘要:

每天,我们都被许多脸部照片轰炸,无论是在社交媒体,电视还是智能手机上。从进化的角度来看,面孔是为了被记住,主要是由于生存和个人相关性。然而,所有这些面孔并没有平等的机会留在我们的脑海里。它已被证明,记忆性是一个图像的内在特征,但它在很大程度上是未知的属性使图像更难忘。在这项工作中,我们的目标是解决这个问题,提出了一种快速的方法来修改和控制人脸图像的记忆性。在我们提出的方法中,我们首先在StyleGAN的潜在空间中找到一个超平面来分离高和低记忆图像。然后,我们修改了图像的可记忆性(同时保持身份和其他面部特征,如年龄,情绪等)。通过在超平面法向量的正或负方向上移动。我们进一步分析了StyleGAN增强潜在空间的不同层如何有助于人脸记忆。这些分析显示了每个人的面部属性如何使图像或多或少令人难忘。最重要的是,我们评估了我们提出的方法,真实和合成的人脸图像。该方法成功地修改和控制真实人脸以及非真实合成人脸的记忆性。我们提出的方法可以用于社交媒体,学习辅助工具或广告目的的照片编辑应用程序。

英文摘要:

Everyday, we are bombarded with many photographs of faces, whether on social media, television, or smartphones. From an evolutionary perspective, faces are intended to be remembered, mainly due to survival and personal relevance. However, all these faces do not have the equal opportunity to stick in our minds. It has been shown that memorability is an intrinsic feature of an image but yet, it is largely unknown what attributes make an image more memorable. In this work, we aimed to address this question by proposing a fast approach to modify and control the memorability of face images. In our proposed method, we first found a hyperplane in the latent space of StyleGAN to separate high and low memorable images. We then modified the image memorability (while maintaining the identity and other facial features such as age, emotion, etc.) by moving in the positive or negative direction of this hyperplane normal vector. We further analyzed how different layers of the StyleGAN augmented latent space contribute to face memorability. These analyses showed how each individual face attribute makes an image more or less memorable. Most importantly, we evaluated our proposed method for both real and synthesized face images. The proposed method successfully modifies and controls the memorability of real human faces as well as unreal synthesized faces. Our proposed method can be employed in photograph editing applications for social media, learning aids, or advertisement purposes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑