Malicious Deepfakes have led to a sharp conflict over distinguishing between genuine and forged faces. Although many countermeasures have been developed to detect Deepfakes ex-post, undoubtedly, passive forensics has not considered any preventive measures for the pristine face before foreseeable manipulations. To complete this forensics ecosystem, we thus put forward the proactive solution dubbed SepMark, which provides a unified framework for source tracing and Deepfake detection. SepMark originates from encoder-decoder-based deep watermarking but with two separable decoders. For the first time the deep separable watermarking, SepMark brings a new paradigm to the established study of deep watermarking, where a single encoder embeds one watermark elegantly, while two decoders can extract the watermark separately at different levels of robustness. The robust decoder termed Tracer that resists various distortions may have an overly high level of robustness, allowing the watermark to survive both before and after Deepfake. The semi-robust one termed Detector is selectively sensitive to malicious distortions, making the watermark disappear after Deepfake. Only SepMark comprising of Tracer and Detector can reliably trace the trusted source of the marked face and detect whether it has been altered since being marked; neither of the two alone can achieve this. Extensive experiments demonstrate the effectiveness of the proposed SepMark on typical Deepfakes, including face swapping, expression reenactment, and attribute editing.
LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localization
School of Computer Science and Engineering（计算机科学与工程学院）；UNSW Sydney（新南威尔士大学悉尼分校）；School of Information and Communication Technology（信息与通信技术学院）；Griffith University（格里菲斯大学）
DeepForgeSeal: Latent Space-Driven Semi-Fragile Watermarking for Deepfake Detection Using Adversarial Reinforcement Learning
The Signal Processing, Artificial Intelligence and Vision Technologies (SAIVT), Queensland University of Technology, Australia（信号处理、人工智能与视觉技术研究所（SAIVT），昆士兰理工大学）
Fudan University（复旦大学）；Chinese Academy of Sciences（中国科学院）；Duke University（杜克大学）
Existing deepfake-detection methods focus on passive detection, i.e., they detect fake face images via exploiting the artifacts produced during deepfake manipulation. A key limitation of passive detection is that it cannot detect fake faces that are generated by new deepfake generation methods. In this work, we propose FaceGuard, a proactive deepfake-detection framework. FaceGuard embeds a watermark into a real face image before it is published on social media. Given a face image that claims to be an individual (e.g., Nicolas Cage), FaceGuard extracts a watermark from it and predicts the face …
WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networks
College of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院）；Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center（新疆多模态智能处理与信息安全工程技术研究中心）；College of Computer Science and Electronic Engineering, Hunan University（湖南大学计算机科学与电子工程学院）；School of Computer Science, Hefei University of Technology（合肥工业大学计算机科学与技术学院）
Whether, Which, and Whose: Solving the Triple Challenge of Deepfake Proactive Forensics in Multi-Face Scenarios
College of Computer Science and Technology（计算机科学与技术学院）；Xinjiang University（新疆大学）；College of Computer Science and Electronic Engineering（计算机科学与电子工程学院）；Hunan University（湖南大学）
GIFGuard: Proactive Forensics against Deepfakes in Facial GIFs via Spatiotemporal Watermarking
School of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院）；College of Computer Science and Electronic Engineering, Hunan University（湖南大学计算机科学与电子工程学院）
San Diego State University（圣地亚哥州立大学）；University of California San Diego（加州大学圣地亚哥分校）
Deepfakes and manipulated media are becoming a prominent threat due to the recent advances in realistic image and video synthesis techniques. There have been several attempts at combating Deepfakes using machine learning classifiers. However, such classifiers do not generalize well to black-box image synthesis techniques and have been shown to be vulnerable to adversarial examples. To address these challenges, we introduce a deep learning based semi-fragile watermarking technique that allows media authentication by verifying an invisible secret message embedded in the image pixels. Instead of …
DiffMark: Diffusion-based Robust Watermark Against Deepfakes
College of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院）；Silk Road Multilingual Cognitive Computing International Cooperation Joint Laboratory（丝绸之路多语种认知计算国际合作联合实验室）；School of Computer Science and Information Engineering, Hefei University of Technology（合肥工业大学计算机科学与信息工程学院）；College of Computer Science and Electronic Engineering, Hunan University（湖南大学计算机科学与电子工程学院）；Department of Computer Science, State University of New York（纽约州立大学计算机科学系）
Deepfakes and Synthetic Media: Generation, Detection, and Governance
Heriot-Watt University（赫瑞-瓦特大学）；Democritus University of Thrace（德谟克利特色雷斯大学）；National and Technical University of Athens（雅典国立技术大学）；Salvezza Energy Systems Ltd.（Salvezza能源系统有限公司）；Hellenic Open University（希腊开放大学）；Aristotle University of Thessaloniki（塞萨洛尼基亚里士多德大学）；Technical University of Sofia（索非亚技术大学）；Hellenic Naval Academy（希腊海军学院）
Robust Identity Perceptual Watermark Against Deepfake Face Swapping
School of Computing, National University of Singapore（新加坡国立大学计算机学院）；Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences)（山东人工智能研究院，齐鲁工业大学（山东科学院））；School of Cyber Security, Qilu University of Technology (Shandong Academy of Sciences)（齐鲁工业大学（山东科学院）网络安全学院）；Key Laboratory of Computing Power Network and Information Security, Ministry of Education, China（教育部计算能力网络与信息安全重点实验室）
