arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.02512cs.CV

ID-Reveal: Identity-aware DeepFake Video Detection

University Federico II of Naples(那不勒斯费德里科二世大学);Technical University of Munich(慕尼黑工业大学);Max Planck Institute for Intelligent Systems, Tübingen(马克斯·普朗克智能系统研究所)

Davide Cozzolino, Andreas Rössler, Justus Thies, Matthias Nießner, Luisa Verdoliva

英文摘要:

A major challenge in DeepFake forgery detection is that state-of-the-art algorithms are mostly trained to detect a specific fake method. As a result, these approaches show poor generalization across different types of facial manipulations, e.g., from face swapping to facial reenactment. To this end, we introduce ID-Reveal, a new approach that learns temporal facial features, specific of how a person moves while talking, by means of metric learning coupled with an adversarial training strategy. The advantage is that we do not need any training data of fakes, but only train on real videos. Moreover, we utilize high-level semantic features, which enables robustness to widespread and disruptive forms of post-processing. We perform a thorough experimental analysis on several publicly available benchmarks. Compared to state of the art, our method improves generalization and is more robust to low-quality videos, that are usually spread over social networks. In particular, we obtain an average improvement of more than 15% in terms of accuracy for facial reenactment on high compressed videos.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑