arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.19334cs.CV

面向人脸活体检测的测试时域泛化

Test-Time Domain Generalization for Face Anti-Spoofing

Shanghai Jiao Tong University(上海交通大学);Youtu Lab, Tencent(腾讯优图实验室);La Trobe University(拉筹伯大学)

Qianyu Zhou, Ke-Yue Zhang, Taiping Yao, Xuequan Lu, Shouhong Ding, Lizhuang Ma

AI总结:

本文提出测试时域泛化框架TTDG,通过测试时风格投影TTSP和多样风格偏移模拟DSSS将未见测试数据投影到已知源域空间,无需测试时更新模型即可提升人脸活体检测的跨域泛化能力。

摘要:

人脸活体检测(FAS)在保护人脸识别系统免受呈现攻击方面至关重要。虽然域泛化(DG)方法已被开发用于提升FAS性能,但它们主要侧重于在训练期间学习域不变特征,这可能无法保证对与源分布差异较大的未见数据具有泛化能力。我们的见解是,测试数据可以作为一种宝贵资源,在DG FAS中超越单纯的评估作用,增强模型的泛化能力。在本文中,我们提出了一种新颖的面向FAS的测试时域泛化(TTDG)框架,该框架利用测试数据来提升模型的泛化能力。我们的方法由测试时风格投影(TTSP)和多样风格偏移模拟(DSSS)组成,能够有效地将未见数据投影到已见域空间。具体而言,我们首先引入创新的TTSP,将测试分布中任意未见样本的风格投影到训练分布的已知源空间。然后,我们设计了高效的DSSS,在超球面特征空间中通过可学习的风格基和两个专门设计的损失函数来合成多样化的风格偏移。我们的方法消除了测试时模型更新的需求,并且可以无缝集成到CNN和ViT骨干网络中。在广泛使用的跨域FAS基准上的综合实验证明了我们方法的最先进性能和有效性。

英文摘要:

Face Anti-Spoofing (FAS) is pivotal in safeguarding facial recognition systems against presentation attacks. While domain generalization (DG) methods have been developed to enhance FAS performance, they predominantly focus on learning domain-invariant features during training, which may not guarantee generalizability to unseen data that differs largely from the source distributions. Our insight is that testing data can serve as a valuable resource to enhance the generalizability beyond mere evaluation for DG FAS. In this paper, we introduce a novel Test-Time Domain Generalization (TTDG) framework for FAS, which leverages the testing data to boost the model's generalizability. Our method, consisting of Test-Time Style Projection (TTSP) and Diverse Style Shifts Simulation (DSSS), effectively projects the unseen data to the seen domain space. In particular, we first introduce the innovative TTSP to project the styles of the arbitrarily unseen samples of the testing distribution to the known source space of the training distributions. We then design the efficient DSSS to synthesize diverse style shifts via learnable style bases with two specifically designed losses in a hyperspherical feature space. Our method eliminates the need for model updates at the test time and can be seamlessly integrated into not only the CNN but also ViT backbones. Comprehensive experiments on widely used cross-domain FAS benchmarks demonstrate our method's state-of-the-art performance and effectiveness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑