arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.09458cs.CV
收藏

G2Face:基于生成先验与几何先验的高保真可逆人脸匿名化

G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors

South China University of Technology(华南理工大学);Guangdong Engineering Center for Large Model and GenAI Technology(广东省大模型与生成式人工智能技术工程中心);State Key Laboratory of Subtropical Building and Urban Science(亚热带建筑与城市科学国家重点实验室);The Hong Kong Polytechnic University(香港理工大学)

Haoxin Yang, Xuemiao Xu, Cheng Xu, Huaidong Zhang, Jing Qin, Yi Wang, Pheng-Ann Heng, Shengfeng He

AI总结:

针对现有可逆人脸匿名化方法细节丢失多、易改变非身份属性的问题,提出结合生成与几何先验的G²Face方法,通过3D几何信息和身份感知特征融合实现高保真匿名化与恢复,性能优于现有技术。

摘要:

可逆人脸匿名化与传统的人脸像素化不同,旨在用人脸合成的替代信息替换人脸图像中的敏感身份信息,在不牺牲图像清晰度的前提下保护隐私。传统方法如编码器-解码器网络,由于学习能力有限,往往会导致人脸细节的大量丢失。此外,依赖预训练GAN(生成对抗网络)中的隐空间操作可能会改变与身份无关的属性,且由于GAN反演的不准确性,会对数据可用性产生负面影响。本文提出G²Face,该方法同时利用生成先验和几何先验来增强身份操控能力,在不损害数据可用性的情况下实现高质量的可逆人脸匿名化。我们使用3D人脸模型从输入人脸中提取几何信息,并将其与基于预训练GAN的解码器相结合。生成先验与几何先验的协同作用使得解码器能够生成几何一致的逼真匿名人脸。此外,我们从原始人脸中提取多尺度人脸特征,并通过我们提出的新型身份感知特征融合模块(IFF)将其与解码器相结合。这种集成能够将生成的人脸图案与原始的非身份相关特征精确融合,从而实现精准的身份操控。大量实验表明,我们的方法在人脸匿名化和恢复方面优于现有的最先进技术,同时保持了较高的数据可用性。代码可在https://github.com/Harxis/G2Face获取。

英文摘要:

Reversible face anonymization, unlike traditional face pixelization, seeks to replace sensitive identity information in facial images with synthesized alternatives, preserving privacy without sacrificing image clarity. Traditional methods, such as encoder-decoder networks, often result in significant loss of facial details due to their limited learning capacity. Additionally, relying on latent manipulation in pre-trained GANs can lead to changes in ID-irrelevant attributes, adversely affecting data utility due to GAN inversion inaccuracies. This paper introduces G\textsuperscript{2}Face, which leverages both generative and geometric priors to enhance identity manipulation, achieving high-quality reversible face anonymization without compromising data utility. We utilize a 3D face model to extract geometric information from the input face, integrating it with a pre-trained GAN-based decoder. This synergy of generative and geometric priors allows the decoder to produce realistic anonymized faces with consistent geometry. Moreover, multi-scale facial features are extracted from the original face and combined with the decoder using our novel identity-aware feature fusion blocks (IFF). This integration enables precise blending of the generated facial patterns with the original ID-irrelevant features, resulting in accurate identity manipulation. Extensive experiments demonstrate that our method outperforms existing state-of-the-art techniques in face anonymization and recovery, while preserving high data utility. Code is available at https://github.com/Harxis/G2Face.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑