arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.12258cs.CV
收藏

提升人脸反欺骗的跨域泛化性:洞见、设计与度量

Advancing Cross-Domain Generalizability in Face Anti-Spoofing: Insights, Design, and Metrics

Naver Cloud(Naver云);Korea University(高丽大学);Hanbat National University(韩巴国立大学);Chung-Ang University(中央大学)

Hyojin Kim, Jiyoon Lee, Yonghyun Jeong, Haneol Jang, YoungJoon Yoo

AI总结:

针对人脸反欺骗跨域泛化中逐帧准确率与实际不稳定性的差距,提出贝叶斯视角的概率集成骨干网络方法及视频级预测度量,在多数据集上实现偏差、方差、HTER和AUC指标的SOTA提升。

摘要:

本文提出了一种增强零样本数据域泛化下反欺骗性能的全新视角。与传统图像分类任务不同,人脸反欺骗数据集展现出独特的泛化特性,亟需新型零样本数据域泛化方法。相较于以往的逐帧欺骗预测,我们引入了一种精细的度量计算方式,通过聚合帧级概率得到视频级预测,以解决报告的逐帧准确率与实际使用场景中不稳定性之间的差距。该方法能够量化模型预测中的偏差(bias)与方差(variance),为模型泛化性提供更精细的分析。我们的研究表明,单纯扩大模型骨干网络规模并不能从本质上改善上述不稳定性,因此我们从贝叶斯视角提出了一种集成骨干网络方法。这种概率集成骨干网络既提升了由所提度量衡量的模型鲁棒性与欺骗检测准确率,还发挥了不确定性度量的优势,支持训练过程中增强采样,从而提升模型在新数据集上的泛化能力。我们在基准数据集OMIC以及公开数据集CelebA-Spoof和SiW-Mv2上评估了所提方法。我们的最终模型在所有数据集上均优于现有最先进方法,在偏差、方差、HTER(半总错误率)和AUC指标上均展现出提升。

英文摘要:

This paper presents a novel perspective for enhancing anti-spoofing performance in zero-shot data domain generalization. Unlike traditional image classification tasks, face anti-spoofing datasets display unique generalization characteristics, necessitating novel zero-shot data domain generalization. One step forward to the previous frame-wise spoofing prediction, we introduce a nuanced metric calculation that aggregates frame-level probabilities for a video-wise prediction, to tackle the gap between the reported frame-wise accuracy and instability in real-world use-case. This approach enables the quantification of bias and variance in model predictions, offering a more refined analysis of model generalization. Our investigation reveals that simply scaling up the backbone of models does not inherently improve the mentioned instability, leading us to propose an ensembled backbone method from a Bayesian perspective. The probabilistically ensembled backbone both improves model robustness measured from the proposed metric and spoofing accuracy, and also leverages the advantages of measuring uncertainty, allowing for enhanced sampling during training that contributes to model generalization across new datasets. We evaluate the proposed method from the benchmark OMIC dataset and also the public CelebA-Spoof and SiW-Mv2. Our final model outperforms existing state-of-the-art methods across the datasets, showcasing advancements in Bias, Variance, HTER, and AUC metrics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑