arXivDaily arXiv每日学术速递 周一至周五更新
看起来今天可以划水了
arXiv 2501.13435cs.CV
收藏

GC-ConsFlow:利用光流残差和全局上下文进行稳健的深度伪造检测

GC-ConsFlow: Leveraging Optical Flow Residuals and Global Context for Robust Deepfake Detection

Changsha University of Science and Technology(长沙理工大学)

Jiaxin Chen, Miao Hu, Dengyong Zhang, Jingyang Meng

AI总结:

提出GC-ConsFlow双流框架,结合全局上下文聚合与光流残差梯度特征,同时捕获空间与时间伪造痕迹,在多种压缩条件下实现稳健的深度伪造视频检测,性能优于现有方法。

摘要:

深度伪造技术的快速发展使得生成高度逼真的操纵视频成为可能,给社会伦理带来了严峻挑战。现有的深度伪造检测方法主要关注空间或时间不一致性,往往忽略两者之间的相互作用,或受到自然面部运动引起的干扰。为解决这些问题,我们提出了全局上下文一致性流(GC-ConsFlow),一种新颖的双流框架,有效整合空间和时间特征以实现稳健的深度伪造检测。集成在全局上下文感知帧流(GCAF)中的全局分组上下文聚合模块(GGCA),通过聚合分组全局上下文信息增强空间特征提取,能够检测帧内细微的空间伪影。流梯度时间一致性流(FGTC)不直接建模残差,而是利用光流残差和基于梯度的特征,提高时间特征提取对非自然面部运动引入的不一致性的鲁棒性。通过结合这两个流,GC-ConsFlow在捕获互补的时空伪造痕迹方面展示了有效性和稳健性。大量实验表明,GC-ConsFlow在各种压缩场景下检测深度伪造视频的性能优于现有最先进方法。

英文摘要:

The rapid development of Deepfake technology has enabled the generation of highly realistic manipulated videos, posing severe social and ethical challenges. Existing Deepfake detection methods primarily focused on either spatial or temporal inconsistencies, often neglecting the interplay between the two or suffering from interference caused by natural facial motions. To address these challenges, we propose the global context consistency flow (GC-ConsFlow), a novel dual-stream framework that effectively integrates spatial and temporal features for robust Deepfake detection. The global grouped context aggregation module (GGCA), integrated into the global context-aware frame flow stream (GCAF), enhances spatial feature extraction by aggregating grouped global context information, enabling the detection of subtle, spatial artifacts within frames. The flow-gradient temporal consistency stream (FGTC), rather than directly modeling the residuals, it is used to improve the robustness of temporal feature extraction against the inconsistency introduced by unnatural facial motion using optical flow residuals and gradient-based features. By combining these two streams, GC-ConsFlow demonstrates the effectiveness and robustness in capturing complementary spatiotemporal forgery traces. Extensive experiments show that GC-ConsFlow outperforms existing state-of-the-art methods in detecting Deepfake videos under various compression scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑