We propose a new method to detect deepfake images using the cue of the source feature inconsistency within the forged images. It is based on the hypothesis that images' distinct source features can be preserved and extracted after going through state-of-the-art deepfake generation processes. We introduce a novel representation learning approach, called pair-wise self-consistency learning (PCL), for training ConvNets to extract these source features and detect deepfake images. It is accompanied by a new image synthesis approach, called inconsistency image generator (I2G), to provide richly annotated training data for PCL. Experimental results on seven popular datasets show that our models improve averaged AUC over the state of the art from 96.45% to 98.05% in the in-dataset evaluation and from 86.03% to 92.18% in the cross-dataset evaluation.
Learning Spatiotemporal Inconsistency via Thumbnail Layout for Face Deepfake Detection
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);University of Science and Technology of China(中国科学技术大学)
Evading DeepFake Detectors via Adversarial Statistical Consistency
Kyushu University(九州大学);Centre for Frontier AI Research (CFAR), A*STAR(新加坡科技研究局前沿人工智能研究中心);Institute of High Performance Computing (IHPC), A*STAR(新加坡科技研究局高性能计算研究所);Nanyang Technological University(南洋理工大学);Singapore Management University(新加坡管理大学);University of Alberta(阿尔伯塔大学);The University of Tokyo(东京大学)
WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networks
College of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center(新疆多模态智能处理与信息安全工程技术研究中心);College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院);School of Computer Science, Hefei University of Technology(合肥工业大学计算机科学与技术学院)
LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection
The Hong Kong Polytechnic University(香港理工大学);University College London(伦敦大学学院);Tsinghua University(清华大学);Sun Yat-sen University(中山大学);National University of Singapore(新加坡国立大学)
Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detection
Machine Intelligence Group, Department of CS&IS, Birla Institute of Technology and Sciences, Pilani, India(比拉理工学院机器智能小组,计算机科学与信息系,印度比拉理工学院,皮兰);University of North Carolina at Charlotte, United States of America(北卡罗来纳大学夏洛特分校,美国)
HOLA: Enhancing Audio-visual Deepfake Detection via Hierarchical Contextual Aggregations and Efficient Pre-training
Xi'an Jiaotong University(西安交通大学);Zhengzhou University(郑州大学);University of Science and Technology of China(中国科学技术大学);Dalian University of Technology(大连理工大学);Zhejiang Lab(浙江实验室)
LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection
CVI SnT University of Luxembourg(卢森堡大学CVI SnT研究所);Cristal Laboratory National School of Computer Sciences University of Manouba(马努巴大学国家计算机科学学院Cristal实验室)
ED$^4$: Explicit Data-level Debiasing for Deepfake Detection
School of computer science, Wuhan University(武汉大学计算机学院);WeChat, Tencent Inc.(腾讯公司);School of electronic and computer engineering, Peking University Shenzhen Graduate School(北京大学深圳研究生院电子与计算机工程学院)
All in One: Unifying Deepfake Detection, Tampering Localization, and Source Tracing with a Robust Landmark-Identity Watermark
School of Computer Science and Technology, Xinjiang University, Urumqi, China(新疆大学计算机科学与技术学院);Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center, Urumqi, China(新疆多模态智能处理与信息安全工程技术研究中心)
Social Networks and Human-Centered Computing Program, Taiwan International Graduate Program, Institute of Information Science, Academia Sinica(中央研究院资讯科学研究所台湾国际研究生计划社交网络与人本计算项目);Department of Computer Science, National Chengchi University(国立政治大学资讯科学系);Institute of Information Systems and Applications, National Tsing Hua University(国立清华大学资讯系统与应用研究所);National Institute of Informatics(国立情报学研究所);Department of Electrical Engineering and the Institute of Communications Engineering, National Tsing Hua University(国立清华大学电机工程学系与通讯工程研究所);Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心);Institute of Information Science, Academia Sinica(中央研究院资讯科学研究所)
Towards Robust DeepFake Detection under Unstable Face Sequences: Adaptive Sparse Graph Embedding with Order-Free Representation and Explicit Laplacian Spectral Prior
Institute of Intelligent Systems, College of Artificial Intelligence and Green Energy, National Yang Ming Chiao Tung University(智能系统研究所,人工智能与绿色能源学院,国立阳明交通大学);Institute of Data Science, National Cheng Kung University(数据科学研究所,国立成功大学)
Generalizable Deepfake Detection Based on Forgery-aware Layer Masking and Multi-artifact Subspace Decomposition
Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology(南京信息工程大学数字取证教育部工程研究中心)