arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.14136cs.CV
收藏

基于双注意力机制和特征融合的改进Xception人脸伪造检测

Improved Xception with Dual Attention Mechanism and Feature Fusion for Face Forgery Detection

Sun Yat-sen University(中山大学)

Hao Lin, Weiqi Luo, Kangkang Wei, Minglin Liu

摘要:

随着深度学习技术的快速发展,越来越多被deepfake伪造的人脸在社交媒体上广泛传播,引发社会严重关注。人脸伪造检测是近年来的一个研究热点,相关的方法也被提出。然而,对于那些低质量和/或不同来源的图像,现有的方法的检测性能仍然远远不能令人满意。本文提出了一种基于双重注意力机制和特征融合的改进Xception人脸伪造检测算法。与原始Xception模型的中间流程不同,本文尝试通过不同层次的卷积来捕捉人脸图像的不同高语义特征,并引入卷积块注意模块和特征融合来细化和重组这些高语义特征。在退出流程中,采用自注意力机制和深度可分离卷积分别学习融合特征的全局信息和局部信息,以提高模型的分类能力。在三个Deepfake数据集上的实验结果表明,该方法在有效性和泛化能力方面优于Xception以及其他相关方法。

英文摘要:

With the rapid development of deep learning technology, more and more face forgeries by deepfake are widely spread on social media, causing serious social concern. Face forgery detection has become a research hotspot in recent years, and many related methods have been proposed until now. For those images with low quality and/or diverse sources, however, the detection performances of existing methods are still far from satisfactory. In this paper, we propose an improved Xception with dual attention mechanism and feature fusion for face forgery detection. Different from the middle flow in original Xception model, we try to catch different high-semantic features of the face images using different levels of convolution, and introduce the convolutional block attention module and feature fusion to refine and reorganize those high-semantic features. In the exit flow, we employ the self-attention mechanism and depthwise separable convolution to learn the global information and local information of the fused features separately to improve the classification the ability of the proposed model. Experimental results evaluated on three Deepfake datasets demonstrate that the proposed method outperforms Xception as well as other related methods both in effectiveness and generalization ability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑