Advanced manipulation techniques have provided criminals with opportunities to make social panic or gain illicit profits through the generation of deceptive media, such as forged face images. In response, various deepfake detection methods have been proposed to assess image authenticity. Sequential deepfake detection, which is an extension of deepfake detection, aims to identify forged facial regions with the correct sequence for recovery. Nonetheless, due to the different combinations of spatial and sequential manipulations, forged face images exhibit substantial discrepancies that severely impact detection performance. Additionally, the recovery of forged images requires knowledge of the manipulation model to implement inverse transformations, which is difficult to ascertain as relevant techniques are often concealed by attackers. To address these issues, we propose Multi-Collaboration and Multi-Supervision Network (MMNet) that handles various spatial scales and sequential permutations in forged face images and achieve recovery without requiring knowledge of the corresponding manipulation method. Furthermore, existing evaluation metrics only consider detection accuracy at a single inferring step, without accounting for the matching degree with ground-truth under continuous multiple steps. To overcome this limitation, we propose a novel evaluation metric called Complete Sequence Matching (CSM), which considers the detection accuracy at multiple inferring steps, reflecting the ability to detect integrally forged sequences. Extensive experiments on several typical datasets demonstrate that MMNet achieves state-of-the-art detection performance and independent recovery performance.
DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysis
Sun Yat-sen University(中山大学);Pengcheng Laboratory(鹏城实验室);Guilin University of Electronic Technology(桂林电子科技大学);Guangdong Key Laboratory of Big Data Analysis and Processing(广东大数据分析与处理重点实验室)
Whether, Which, and Whose: Solving the Triple Challenge of Deepfake Proactive Forensics in Multi-Face Scenarios
College of Computer Science and Technology(计算机科学与技术学院);Xinjiang University(新疆大学);College of Computer Science and Electronic Engineering(计算机科学与电子工程学院);Hunan University(湖南大学)
Investigating the Viability of Employing Multi-modal Large Language Models in the Context of Audio Deepfake Detection
Indian Institute of Technology, Ropar, India(印度理工学院罗帕尔分校);Machine Intelligence Group, Birla Institute of Technology and Science, Pilani, Hyderabad Campus, India(比拉理工科学院帕利尼 Hyderabad 分校机器智能小组);Monash University, Melbourne, Australia(墨尔本大学)
Generalizable Deepfake Detection Based on Forgery-aware Layer Masking and Multi-artifact Subspace Decomposition
Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology(南京信息工程大学数字取证教育部工程研究中心)
Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces
College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院);National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);School of Cyber Science and Engineering, Wuhan University(武汉大学网络空间安全学院)
本文提出 Recap 深度伪造检测模型,通过随机掩蔽 ROI 恢复人脸并以恢复结果监督面部映射,放大真假视频差异,在多个标准基准场景中验证有效。
Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection
Nanyang Technological University(南洋理工大学);Ant Digital Technologies, Ant Group(蚂蚁数字科技,蚂蚁集团);Singapore University of Technology and Design(新加坡科技设计大学);Singapore Management University(新加坡管理大学)
Counterfactual Explanations for Face Forgery Detection via Adversarial Removal of Artifacts
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Nanjing University of Information Science and Technology(南京信息工程大学)
EDVD-LLaMA: Explainable Deepfake Video Detection via Multimodal Large Language Model Reasoning
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University(电子与电气工程系,香港理工大学);School of Electrical and Electronic Engineering, Nanyang Technological University(电子与电气工程学院,南洋理工大学);Shien-Ming Wu School of Intelligent Engineering, South China University of Technology(智能工程学院,华南理工大学)