Face Anti-spoofing (FAS) is a challenging problem due to complex serving scenarios and diverse face presentation attack patterns. Especially when captured images are low-resolution, blurry, and coming from different domains, the performance of FAS will degrade significantly. The existing multi-modal FAS datasets rarely pay attention to the cross-domain problems under deployment scenarios, which is not conducive to the study of model performance. To solve these problems, we explore the fine-grained differences between multi-modal cameras and construct a cross-domain multi-modal FAS dataset under surveillance scenarios called GREAT-FASD-S. Besides, we propose an Attention based Face Anti-spoofing network with Feature Augment (AFA) to solve the FAS towards low-quality face images. It consists of the depthwise separable attention module (DAM) and the multi-modal based feature augment module (MFAM). Our model can achieve state-of-the-art performance on the CASIA-SURF dataset and our proposed GREAT-FASD-S dataset.
CASIA-SURF: A Large-scale Multi-modal Benchmark for Face Anti-spoofing
National Laboratory of Pattern Recognition (NLPR), Institute of Automation Chinese Academy of Sciences (CASIA) and University of Chinese Academy of Sciences (UCAS)(中国科学院自动化研究所(CASIA)模式识别国家重点实验室(NLPR)和中国科学院大学(UCAS));Macau University of Science and Technology (MUST)(澳门科技大学(MUST));Institute of Deep Learning, Baidu Research(百度研究院深度学习研究所);National Engineering Laboratory for Deep Learning Technology and Application(深度学习技术及应用国家工程实验室);Universitat de Barcelona (UB) and Computer Vision Center (CVC)(巴塞罗那大学(UB)和计算机视觉中心(CVC));Instituto Nacional de Astrofísica, Óptica y Electrónica(国立天体物理、光学与电子研究所(INAOE));Computer Science Department at CINVESTAV-Zacatenco(CINVESTAV-萨卡特科恩科计算机科学系);Westlake University and Institute of Automation Chinese Academy of Sciences (CASIA)(西湖大学和中国科学院自动化研究所(CASIA))
Great Bay University(大湾区大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);SailYond Technology(赛扬科技);University of Oulu(奥卢大学);Nanjing University of Information Science and Technology(南京信息工程大学)
Robust Multi-Modal Face Anti-Spoofing with Domain Adaptation: Tackling Missing Modalities, Noisy Pseudo-Labels, and Model Degradation
College of Computer and Cyber Security, Fujian Normal University(计算机与网络安全部,福建师范大学);Department of Computer Science, National Tsing Hua University(计算机科学系,国立清华大学)
Rethinking Vision Transformer and Masked Autoencoder in Multimodal Face Anti-Spoofing
Great Bay University(大湾区大学);Nanyang Technological University(南洋理工大学);University of Oulu(奥卢大学);Lappeenranta-Lahti University of Technology(拉彭兰塔-拉赫蒂理工大学);South China University of Technology(华南理工大学)
近年来,基于视觉Transformer(ViT)的多模态学习方法被提出来提高人脸反欺骗(FAS)系统的鲁棒性。然而,仍然没有工作来探索的基本性质(\textit{e.g.},模态感知输入,合适的多模态预训练,和有效的微调),在香草ViT多模态FAS。在本文中,我们研究了三个关键因素(即,输入、预训练和微调),用于具有RGB、红外(IR)和深度的多模态FAS。首先,在ViT输入方面,我们发现利用局部特征描述符有利于IR模态上的ViT,而不是RGB或深度模态。其次,在观察的效率直接微调整个或部分ViT,我们设计了一个自适应多模态适配器(AMA),它可以有效地聚合本地多模态功能,同时冻结大多数ViT参数。最后,考虑到任务(FAS与通用对象分类)和模态(多模态与单峰)的差距,ImageNet预训练模型对于多模态FAS任务可能是次优的。为了弥合这些差距,我们提出了模态非对称掩码自编码器(M $^{2}$ A $^{2}$ E),用于多模态FAS自监督预训练,而无需昂贵的注释标签。与先前的模态对称自动编码器相比,所提出的M $^{2}$ A $^{2}$ E能够学习更多内在的任务感知表示并且与模态不可知(例如,单峰、双峰和三峰)下游设置。在多模态FAS基准上进行的单峰(RGB,深度,IR)和多模态(RGB+深度,RGB+IR,深度+IR,RGB+深度+IR)设置的广泛实验证明了所提出的方法的优…
University of Chinese Academy of Sciences (UCAS)(中国科学院大学);Beijing Normal University(北京师范大学);SailYond Technology(赛扬德科技);Universitat de Barcelona (UB)(巴塞罗那大学);Computer Vision Center (CVC)(计算机视觉中心);Aalborg University (AAU)(奥尔堡大学);Westlake University(西湖大学)
Multi-Modal Face Anti-Spoofing Based on Central Difference Networks
University of Oulu(奥卢大学);Northwestern Polytechnical University(西北工业大学);Mininglamp Academy of Sciences, Mininglamp Technology(明略科技集团明略科学院);Authenmetric(中科博宏)
FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofing
Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);Baidu Research(百度研究院);Great Bay University(大湾区大学);Mininglamp Academy of Sciences, Mininglamp Technology(明略科技明略科学院);Macau University of Science and Technology(澳门科技大学);Westlake University(西湖大学)
Cross-ethnicity Face Anti-spoofing Recognition Challenge: A Review
Beijing Jiaotong University(北京交通大学);Universitat de Barcelona(巴塞罗那大学);Computer Vision Center(计算机视觉中心);Instituto Nacional de Astrofísica, Óptica y Electrónica(国家天体物理、光学与电子研究所);Beihang University(北京航空航天大学);Baidu Research(百度研究院);Westlake University(西湖大学)
人脸反欺骗对于防止人脸识别系统的安全漏洞至关重要。由于深度神经网络的优异性能和大数据集的可用性,生物识别社区最近取得了令人印象深刻的进展。虽然种族偏见已被证实严重影响人脸识别系统的性能,它仍然是一个开放的人脸反欺骗的研究问题。最近,一个多种族人脸反欺骗数据集CASIA-SURF CeFA已经发布,其目标是测量种族偏见。它是迄今为止最大的跨种族人脸反欺骗数据集,涵盖$3$种族,$3$模式,$1,607$主题,2D加3D攻击类型,以及最近发布的人脸反欺骗数据集中第一个包含明确种族标签的数据集。我们组织了Chalearn Face Anti-spoofing Attack Detection Challenge,其中包括单模态(例如,RGB)和多模态(例如,RGB,深度,红外(IR))围绕这一新资源进行跟踪,以促进旨在减轻种族偏见的研究。两个赛道在开发阶段都吸引了$340$团队,最终分别有11支和8支团队在单模态和多模态人脸反欺骗识别挑战赛中提交了代码。所有的结果都经过组织团队的验证和重新运行,结果用于最终排名。本文概述了挑战,包括其设计,评估协议和结果总结。我们分析排名靠前的解决方案,并从竞争中得出结论。此外,我们还概述了今后的工作方向。
DADM: Dual Alignment of Domain and Modality for Face Anti-spoofing
Great Bay University(大西洋大学);University of Science and Technology of China(中国科学技术大学);Dongguan Key Laboratory for Intelligence and Information Technology(东莞智能与信息技术重点实验室);GRGBanking Equipment Co., Ltd.(GRGBanking设备有限公司);South China University of Technology(华南理工大学);Lappeenranta University of Technology(拉普兰塔理工大学);Macao Polytechnic University(澳门理工学院);Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区)
Multi-Modal Face Anti-Spoofing via Cross-Modal Feature Transitions
College of Computer and Cyber Security, Fujian Normal University(计算机与网络安全学院,福建师范大学);Department of Computer Science, National Tsing Hua University(计算机科学系,国立清华大学)
Great Bay University(大湾区大学);Nanyang Technological University(南洋理工大学);University of Oulu(奥卢大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Shenzhen University(深圳大学)
Learning Representation and Synergy Invariances: A Povable Framework for Generalized Multimodal Face Anti-Spoofing
Beihang University(北京航空航天大学);Nanyang Technological University(南洋理工大学);Westlake University(西湖大学);Great Bay University(大亚湾大学);Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区)
Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking
University of Chinese Academic of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Institute of North Electronic Equipment(北方电子设备研究所);Baidu Research(百度研究院)
Feature Fusion and Knowledge-Distilled Multi-Modal Multi-Target Detection
School of Information and Communications, Hanoi University of Science and Technology(信息与通信学院,河内科学技术大学);Telecom Neural Detection Lab, Polytechnique Montréal(电信神经检测实验室,蒙特利尔理工学院)
SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);Department of Artificial Intelligence, Xiamen University(厦门大学人工智能系);School of Information Science and Technology, Shijiazhuang Tiedao University(石家庄铁道大学信息科学与技术学院);Electrical Engineering Department, UCLA(加州大学洛杉矶分校电子工程系);New Laboratory of Pattern Recognition(NLPR), Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别新实验室);College of Electronics and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);School of Computing and Information Technology, Great Bay University(广东东莞Great Bay大学计算与信息科技学院);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络科学与技术学院)
Surveillance Face Presentation Attack Detection Challenge
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Universitat de Barcelona(巴塞罗那大学);Computer Vision Center(计算机视觉中心);Instituto Nacional de Astrofísica, Óptica y Electrónica(国家天体物理、光学与电子研究所);CAS(中国科学院)
Multi-Modal Graph Neural Network-Inspired Vessel Identification and Tracking for UAV-Based Maritime Surveillance
Wuhan University of Technology(武汉理工大学);University of Aberdeen(阿伯丁大学);Guangdong University of Technology(广东工业大学);The Hong Kong Polytechnic University(香港理工大学)
Purify then Guide: Rethinking Domain Generalization for Multimodal Face Anti-Spoofing
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);School of Computing and Information Technology, Great Bay University(大湾区大学计算与信息科技学院);Dongguan Key Laboratory for Intelligence and Information Technology(东莞智能与信息处理重点实验室);Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen University(广东省智能信息处理重点实验室);Tencent Youtu Lab(腾讯优图实验室);School of Psychology, Shanghai Jiao Tong University(上海交通大学心理学院);Faculty of Applied Sciences, Macao Polytechnic University(澳门理工学院应用科学学院);The Chinese University of Hong Kong(香港中文大学)
BIG-MoE: Bypass Isolated Gating MoE for Generalized Multimodal Face Anti-Spoofing
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机与软件学院);Great Bay University(大湾区大学);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University(深圳大学大数据系统计算技术国家工程实验室);Guangdong Provincial Key Laboratory of Intelligent Information Processing(广东省智能信息处理重点实验室)
FeatherNets: Convolutional Neural Networks as Light as Feather for Face Anti-spoofing
Intel IAGS SSP(英特尔IAGS SSP);Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology(华中科技大学武汉光电国家研究中心);Huazhong University of Science and Technology(华中科技大学)
Domain Generalization for Face Anti-spoofing via Content-aware Composite Prompt Engineering
School of Computer Science, Hefei University of Technology(合肥工业大学计算机学院);State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);School of Electronic Information Engineering, Taiyuan University of Technology(太原理工大学电子信息工程学院);School of Computer Science and Engineering, Faculty of Innovation Engineering, Macau University of Science and Technology(澳门科技大学创新工程学院计算机科学与工程学院);School of Cyber Science and Engineering, Wuhan University(武汉大学网络空间安全学院)
University of Oulu(奥卢大学);Communication University of China(中国传媒大学);SailYond Technology(赛扬德科技);Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);University of Chinese Academy of Sciences (UCAS)(中国科学院大学);Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院)
TrafficLoc: Localizing Traffic Surveillance Cameras in 3D Scenes
Technical University of Munich(慕尼黑工业大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);DeepScenario;Visual Geometry Group, University of Oxford(牛津大学视觉几何组)