arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.03043cs.CV
收藏

SlerpFace:基于球面线性插值的人脸模板保护

SlerpFace: Face Template Protection via Spherical Linear Interpolation

Fudan University(复旦大学);Tencent(腾讯)

Zhizhou Zhong, Yuxi Mi, Yuge Huang, Jianqing Xu, Guodong Mu, Shouhong Ding, Jingyun Zhang, Rizen Guo, Yunsheng Wu, Shuigeng Zhou

AI总结:

本文提出SlerpFace人脸模板保护方法,通过超球面球面线性插值将模板旋转至噪声分布,并结合分组丢弃特征维度增强不可逆性,在保持识别精度的同时有效抵御基于扩散模型的逆向攻击。

摘要:

当代人脸识别系统使用从人脸图像中提取的特征模板来识别个人。为增强隐私性,人脸模板保护技术被广泛用于隐藏模板中存储的敏感身份和外貌信息。本文识别出一种利用扩散模型的新兴隐私攻击形式,该攻击可能使先前的保护失效。这种攻击能够从模板中合成高质量、保持身份的人脸图像,从而泄露个人外貌。基于对扩散模型生成能力的研究,本文提出一种防御方法,通过将模板旋转到类似噪声的分布来实现。该方法通过在模板所在超球面上进行球面线性插值高效实现。本文进一步提出按组划分并丢弃模板特征维度,以增强旋转后模板的不可逆性。所提技术被具体化为一种新型人脸模板保护技术——SlerpFace。大量实验表明,SlerpFace在提供令人满意的识别准确率的同时,能够全面抵御逆向攻击及其他攻击形式,优于现有技术。

英文摘要:

Contemporary face recognition systems use feature templates extracted from face images to identify persons. To enhance privacy, face template protection techniques are widely employed to conceal sensitive identity and appearance information stored in the template. This paper identifies an emerging privacy attack form utilizing diffusion models that could nullify prior protection. The attack can synthesize high-quality, identity-preserving face images from templates, revealing persons' appearance. Based on studies of the diffusion model's generative capability, this paper proposes a defense by rotating templates to a noise-like distribution. This is achieved efficiently by spherically and linearly interpolating templates on their located hypersphere. This paper further proposes to group-wisely divide and drop out templates' feature dimensions, to enhance the irreversibility of rotated templates. The proposed techniques are concretized as a novel face template protection technique, SlerpFace. Extensive experiments show that SlerpFace provides satisfactory recognition accuracy and comprehensive protection against inversion and other attack forms, superior to prior arts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑