arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.02003cs.CV

GenFace:一个大规模细粒度人脸伪造基准与跨外观-边缘学习

GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning

Shenzhen University(深圳大学);Great Bay University(湾区大学);Nanyang Technological Uni(南洋理工大学)

Yaning Zhang, Zitong Yu, Tianyi Wang, Xiaobin Huang, Linlin Shen, Zan Gao, Jianfeng Ren

AI总结:

针对逼真扩散模型生成图像带来的伪造检测挑战,本文提出了大规模细粒度高保真人脸伪造基准GenFace,并设计了跨外观-边缘学习(CAEL)检测器与外观-边缘交叉注意力(AECA)模块,在多种跨设置评估中超越现有技术。

摘要:

逼真生成器的快速发展已到达一个关键节点,真实图像与篡改图像之间的差异越来越难以区分。因此,对检测数字篡改的技术进行基准测试和推进成为一个紧迫的问题。尽管已有许多公开可用的人脸伪造数据集,但这些伪造人脸大多使用基于GAN的合成技术生成,并未涉及像扩散模型这样的最新技术。扩散模型生成图像的多样性和质量已得到显著提升,因此应使用一个更具挑战性的人脸伪造数据集来评估SOTA伪造检测文献。在本文中,我们提出了一个大规模、多样化、细粒度且高保真的数据集,即GenFace,以促进deepfake检测的进步,该数据集包含由扩散模型等先进生成器生成的大量伪造人脸,以及关于篡改方法和所用生成器的更详细标签。除了在我们的基准上评估SOTA方法外,我们还设计了一个创新的跨外观-边缘学习(CAEL)检测器,以捕获多粒度的外观和边缘全局表示,并检测具有判别性和通用性的伪造痕迹。此外,我们设计了一个外观-边缘交叉注意力(AECA)模块,以探索两个领域之间的各种整合方式。大量实验结果和可视化表明,我们的检测模型在跨生成器、跨伪造和跨数据集评估等不同设置下均优于现有技术。代码和数据集将可在 https://github.com/Jenine-321/GenFace 获取。

英文摘要:

The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable. Thus, benchmarking and advancing techniques detecting digital manipulation become an urgent issue. Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology, which does not involve the most recent technologies like diffusion. The diversity and quality of images generated by diffusion models have been significantly improved and thus a much more challenging face forgery dataset shall be used to evaluate SOTA forgery detection literature. In this paper, we propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection, which contains a large number of forgery faces generated by advanced generators such as the diffusion-based model and more detailed labels about the manipulation approaches and adopted generators. In addition to evaluating SOTA approaches on our benchmark, we design an innovative cross appearance-edge learning (CAEL) detector to capture multi-grained appearance and edge global representations, and detect discriminative and general forgery traces. Moreover, we devise an appearance-edge cross-attention (AECA) module to explore the various integrations across two domains. Extensive experiment results and visualizations show that our detection model outperforms the state of the arts on different settings like cross-generator, cross-forgery, and cross-dataset evaluations. Code and datasets will be available at \url{https://github.com/Jenine-321/GenFace

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑