arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.08243cs.CV
收藏

基于更细粒度域划分与解耦活体无关因素的泛化性人脸反欺骗

Generalized Face Anti-spoofing via Finer Domain Partition and Disentangling Liveness-irrelevant Factors

University of Science and Technology of China(中国科学技术大学);Great Bay University(大湾区大学);Anhui Tsinglink Information Technology Co.,Ltd.(安徽清科瑞智信息技术有限公司)

Jingyi Yang, Zitong Yu, Xiuming Ni, Jia He, Hui Li

AI总结:

该研究针对人脸反欺骗域泛化问题,提出基于身份的细粒度域划分、风格处理模块与非对称对比损失,在跨数据集等场景下实现了当前最优的反欺骗性能。

摘要:

基于域泛化的人脸反欺骗技术近年来得到广泛研究,现有方法采用对抗学习和元学习技术来学习域不变表征。然而,以往方法通常将数据集差异视为域偏移的主要驱动因素,这种视角粒度不足,无法准确反映数据间的内在差异。在本研究中,我们基于身份而非数据集重新定义域,旨在解耦活体属性与身份属性;我们提出要忽略身份偏移的负面影响,通过将活体特征与身份特征正交化,专注于学习身份不变的活体表征。为应对风格偏移,我们提出Style Cross模块以扩充风格多样性,同时提出Channel-wise Style Attention模块以降低对风格偏移的敏感度,目标是学习鲁棒的活体表征。此外,考虑到真人人脸样本与欺骗样本之间的不对称性,我们提出了一种新型对比损失——Asymmetric Augmented Instance Contrast(非对称增强实例对比损失)。在四个公开数据集上开展的大量实验表明,我们的方法在跨数据集场景和源数据集有限场景下均达到了state-of-the-art(当前最优)性能;此外,该方法在扩充身份多样性时具备良好的可扩展性,相关代码即将发布。

英文摘要:

Face anti-spoofing techniques based on domain generalization have recently been studied widely. Adversarial learning and meta-learning techniques have been adopted to learn domain-invariant representations. However, prior approaches often consider the dataset gap as the primary factor behind domain shifts. This perspective is not fine-grained enough to reflect the intrinsic gap among the data accurately. In our work, we redefine domains based on identities rather than datasets, aiming to disentangle liveness and identity attributes. We emphasize ignoring the adverse effect of identity shift, focusing on learning identity-invariant liveness representations through orthogonalizing liveness and identity features. To cope with style shifts, we propose Style Cross module to expand the stylistic diversity and Channel-wise Style Attention module to weaken the sensitivity to style shifts, aiming to learn robust liveness representations. Furthermore, acknowledging the asymmetry between live and spoof samples, we introduce a novel contrastive loss, Asymmetric Augmented Instance Contrast. Extensive experiments on four public datasets demonstrate that our method achieves state-of-the-art performance under cross-dataset and limited source dataset scenarios. Additionally, our method has good scalability when expanding diversity of identities. The codes will be released soon.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑