arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.07201cs.CV
收藏

用于Deepfake检测的以真实为中心的一致性学习

Real-centric Consistency Learning for Deepfake Detection

Nanjing University of Science and Technology(南京理工大学)

Ruiqi Zha, Zhichao Lian, Qianmu Li, Siqi Gu

摘要:

以前的大多数深度伪造检测研究都致力于以人类可感知的方式描述和区分伪影,这在学习网络中留下了偏见,忽略了类内的一些关键不变性特征,并且表现出互联网干扰的鲁棒性。从本质上讲,deepfake检测问题的目标是在表示空间上有区别地表示自然人脸和虚假人脸,它提醒我们是否可以通过约束类内一致性和类间不一致性来优化表示空间上的特征提取过程,以使类内表示接近并将类间表示分开?因此,受对比表示学习的启发,我们通过学习两个类的不变表示来解决深度伪造检测问题,并提出了一种新的以实为中心的一致性学习方法。我们从样本水平和特征水平两个方面对表示进行约束。在样本层面,我们考虑了deepfake合成的过程,并提出了一种新的基于伪造语义的配对策略来挖掘潜在的生成相关特征。在特征层,基于自然人脸在表示空间的中心,设计了一种硬正挖掘和合成方法来模拟潜在的边缘特征。此外,设计了一种硬负融合方法,利用我们提出的有监督对比边缘损失来提高负边缘特征的区分度。通过大量的实验证明了该方法的有效性和鲁棒性。

英文摘要:

Most of previous deepfake detection researches bent their efforts to describe and discriminate artifacts in human perceptible ways, which leave a bias in the learned networks of ignoring some critical invariance features intra-class and underperforming the robustness of internet interference. Essentially, the target of deepfake detection problem is to represent natural faces and fake faces at the representation space discriminatively, and it reminds us whether we could optimize the feature extraction procedure at the representation space through constraining intra-class consistence and inter-class inconsistence to bring the intra-class representations close and push the inter-class representations apart? Therefore, inspired by contrastive representation learning, we tackle the deepfake detection problem through learning the invariant representations of both classes and propose a novel real-centric consistency learning method. We constraint the representation from both the sample level and the feature level. At the sample level, we take the procedure of deepfake synthesis into consideration and propose a novel forgery semantical-based pairing strategy to mine latent generation-related features. At the feature level, based on the centers of natural faces at the representation space, we design a hard positive mining and synthesizing method to simulate the potential marginal features. Besides, a hard negative fusion method is designed to improve the discrimination of negative marginal features with the help of supervised contrastive margin loss we developed. The effectiveness and robustness of the proposed method has been demonstrated through extensive experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑