arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.09311cs.CV
收藏

学习Deepfake检测的自一致性

Learning Self-Consistency for Deepfake Detection

University of Michigan(密歇根大学);Amazon/AWS AI(亚马逊/亚马逊云服务人工智能部门)

Tianchen Zhao, Xiang Xu, Mingze Xu, Hui Ding, Yuanjun Xiong, Wei Xia

摘要:

我们提出了一种新的方法来检测deepfake图像,使用伪造图像中源特征不一致的线索。它基于这样的假设,即在经过最先进的deepfake生成过程后,图像的独特源特征可以被保留和提取。我们引入了一种新的表示学习方法,称为成对自一致性学习(PCL),用于训练ConvNets提取这些源特征并检测deepfake图像。它伴随着一个新的图像合成方法,称为不一致图像生成器(I2 G),提供丰富的注释训练数据的PCL。在七个流行数据集上的实验结果表明,我们的模型在数据集内评估中将平均AUC从96.45%提高到98.05%,在跨数据集评估中从86.03%提高到92.18%。

英文摘要:

We propose a new method to detect deepfake images using the cue of the source feature inconsistency within the forged images. It is based on the hypothesis that images' distinct source features can be preserved and extracted after going through state-of-the-art deepfake generation processes. We introduce a novel representation learning approach, called pair-wise self-consistency learning (PCL), for training ConvNets to extract these source features and detect deepfake images. It is accompanied by a new image synthesis approach, called inconsistency image generator (I2G), to provide richly annotated training data for PCL. Experimental results on seven popular datasets show that our models improve averaged AUC over the state of the art from 96.45% to 98.05% in the in-dataset evaluation and from 86.03% to 92.18% in the cross-dataset evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑