University of Chinese Academy of Sciences (UCAS)(中国科学院大学);Beijing Normal University(北京师范大学);SailYond Technology(赛扬德科技);Universitat de Barcelona (UB)(巴塞罗那大学);Computer Vision Center (CVC)(计算机视觉中心);Aalborg University (AAU)(奥尔堡大学);Westlake University(西湖大学)
Hao Fang, Ajian Liu, Jun Wan, Sergio Escalera, Chenxu Zhao, Xu Zhang, Stan Z. Li, Zhen Lei
Face Anti-spoofing (FAS) is essential to secure face recognition systems from various physical attacks. However, recent research generally focuses on short-distance applications (i.e., phone unlocking) while lacking consideration of long-distance scenes (i.e., surveillance security checks). In order to promote relevant research and fill this gap in the community, we collect a large-scale Surveillance High-Fidelity Mask (SuHiFiMask) dataset captured under 40 surveillance scenes, which has 101 subjects from different age groups with 232 3D attacks (high-fidelity masks), 200 2D attacks (posters, portraits, and screens), and 2 adversarial attacks. In this scene, low image resolution and noise interference are new challenges faced in surveillance FAS. Together with the SuHiFiMask dataset, we propose a Contrastive Quality-Invariance Learning (CQIL) network to alleviate the performance degradation caused by image quality from three aspects: (1) An Image Quality Variable module (IQV) is introduced to recover image information associated with discrimination by combining the super-resolution network. (2) Using generated sample pairs to simulate quality variance distributions to help contrastive learning strategies obtain robust feature representation under quality variation. (3) A Separate Quality Network (SQN) is designed to learn discriminative features independent of image quality. Finally, a large number of experiments verify the quality of the SuHiFiMask dataset and the superiority of the proposed CQIL.
Learning Meta Model for Zero- and Few-shot Face Anti-spoofing
Northwestern Polytechnical University(西北工业大学);AIBEE;National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Science(中国科学院自动化研究所模式识别国家重点实验室);Winsense Technology Ltd(文思海辉技术有限公司);University of Oulu(奥卢大学)
Learning Generalizable and Identity-Discriminative Representations for Face Anti-Spoofing
University of Electronic Science and Technology of China(电子科技大学);National University of Singapore(新加坡国立大学);National University of Defense Technology(国防科技大学)
Cross-ethnicity Face Anti-spoofing Recognition Challenge: A Review
Beijing Jiaotong University(北京交通大学);Universitat de Barcelona(巴塞罗那大学);Computer Vision Center(计算机视觉中心);Instituto Nacional de Astrofísica, Óptica y Electrónica(国家天体物理、光学与电子研究所);Beihang University(北京航空航天大学);Baidu Research(百度研究院);Westlake University(西湖大学)
人脸反欺骗对于防止人脸识别系统的安全漏洞至关重要。由于深度神经网络的优异性能和大数据集的可用性,生物识别社区最近取得了令人印象深刻的进展。虽然种族偏见已被证实严重影响人脸识别系统的性能,它仍然是一个开放的人脸反欺骗的研究问题。最近,一个多种族人脸反欺骗数据集CASIA-SURF CeFA已经发布,其目标是测量种族偏见。它是迄今为止最大的跨种族人脸反欺骗数据集,涵盖$3$种族,$3$模式,$1,607$主题,2D加3D攻击类型,以及最近发布的人脸反欺骗数据集中第一个包含明确种族标签的数据集。我们组织了Chalearn Face Anti-spoofing Attack Detection Challenge,其中包括单模态(例如,RGB)和多模态(例如,RGB,深度,红外(IR))围绕这一新资源进行跟踪,以促进旨在减轻种族偏见的研究。两个赛道在开发阶段都吸引了$340$团队,最终分别有11支和8支团队在单模态和多模态人脸反欺骗识别挑战赛中提交了代码。所有的结果都经过组织团队的验证和重新运行,结果用于最终排名。本文概述了挑战,包括其设计,评估协议和结果总结。我们分析排名靠前的解决方案,并从竞争中得出结论。此外,我们还概述了今后的工作方向。
Deep Tree Learning for Zero-shot Face Anti-Spoofing
Michigan State University(密歇根州立大学)
人脸反欺骗旨在防止人脸识别系统将假面孔识别为真正的用户。虽然先进的面部反欺骗方法被开发出来,但新类型的欺骗攻击也正在产生,并成为对所有现有系统的威胁。我们将未知欺骗攻击的检测定义为零镜头人脸反欺骗(Zero-Shot Face Anti-Spoofing,简称ZEFA)。以前的研究工作只研究了1-2种欺骗攻击,如打印/重放攻击,这限制了对该问题的深入了解。在这项工作中,我们扩展的欺骗攻击,包括打印攻击,重放攻击,3D面具攻击等13种类型的广泛的欺骗问题,提出了一种新的深度树网络(DTN)来解决的欺骗问题。学习树以无监督的方式将欺骗样本划分为语义子组。当数据样本到达时,无论是已知攻击还是未知攻击,DTN都将其路由到最相似的欺骗集群,并做出二分判决。此外,为了使研究的反欺骗FA,我们介绍了第一个面对反欺骗数据库,其中包含不同类型的欺骗攻击。实验结果表明,该方法在多个测试协议上达到了最佳的测试效果。
Improving Face Anti-Spoofing by 3D Virtual Synthesis
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);First Research Institute of the Ministry of Public Security of PRC(中华人民共和国公安部第一研究所)
Multi-Modal Face Anti-Spoofing Based on Central Difference Networks
University of Oulu(奥卢大学);Northwestern Polytechnical University(西北工业大学);Mininglamp Academy of Sciences, Mininglamp Technology(明略科技集团明略科学院);Authenmetric(中科博宏)
University of Oulu(奥卢大学);Chinese Academy of Sciences(中国科学院);Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Xi’an Jiaotong University(西安交通大学)
Learning deep forest with multi-scale Local Binary Pattern features for face anti-spoofing
Nanyang Technological University(南洋理工大学);Shenzhen University(深圳大学);Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院)
BIG-MoE: Bypass Isolated Gating MoE for Generalized Multimodal Face Anti-Spoofing
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机与软件学院);Great Bay University(大湾区大学);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University(深圳大学大数据系统计算技术国家工程实验室);Guangdong Provincial Key Laboratory of Intelligent Information Processing(广东省智能信息处理重点实验室)
Revisiting Pixel-Wise Supervision for Face Anti-Spoofing
Center for Machine Vision and Signal Analysis, University of Oulu(奥卢大学机器视觉与信号分析中心);Xi’an Jiaotong University(西安交通大学);Northwestern Polytechnical University(西北工业大学)
Spoof Trace Discovery for Deep Learning Based Explainable Face Anti-Spoofing
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS);China Mobile Financial Technology Co., Ltd.(中国移动金融科技有限公司);Guangzhou Pixel Solutions Co., Ltd.(广州像素解决方案有限公司);Center for Machine Vision and Signal Analysis, University of Oulu(奥卢大学机器视觉与信号分析中心);CAIR, HKSIS, Chinese Academy of Sciences(中国科学院香港创新研究所有限公司);SCSE, the Faculty of Innovation Engineering, M.U.S.T(澳门创新工程学院SCSE)
Face Anti-Spoofing by Learning Polarization Cues in a Real-World Scenario
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Center for Research on Intelligent Perception and Computing(智能感知与计算研究中心);Tianjin Academy for Intelligent Recognition Technologies(天津智能识别技术研究院)
Communication University of China(中国传媒大学);Northwestern Polytechnical University(西北工业大学);University of Oulu(奥卢大学);Beijing Kwai Technology Co., Ltd(北京快手科技有限公司);MiningLamp Technology(明略科技);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院)
Face Anti-Spoofing(FAS)保护面部识别免受演示攻击(PA)。现有的FAS方法通常用手工制作的二进制或像素标签来监督PA检测器。然而,手工制作的标签可能不是监督PA检测器学习足够的和内在的欺骗线索的最适当的方式。而不是使用手工制作的标签,我们提出了一种新的元教师FAS(MT-FAS)方法训练元教师监督PA检测器更有效。元教师以双级优化的方式被训练以学习监督PA检测器学习丰富的欺骗线索的能力。双层优化包含两个关键组成部分:1)较低级别的训练,其中元教师监督检测器在训练集上的学习过程;以及2)较高级别的训练,其中元教师的教学性能通过最小化检测器的验证损失来优化。我们的元教师与现有的师生模型有很大的不同,因为元教师是为了更好地教授检测器(学生)而明确训练的,而现有的教师则是为了突出的准确性而忽略教学能力而训练的。在五个FAS基准测试上的广泛实验表明,使用所提出的MT-FAS,经过训练的元教师1)提供比手工制作的标签和现有的师生模型更适合的监督; 2)显着提高PA检测器的性能。
Modeling Spoof Noise by De-spoofing Diffusion and its Application in Face Anti-spoofing
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)