arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.12051cs.CV
收藏

视频中虚假人脸的检测

Detection of fake faces in videos

RV College of Engineering(RV工程学院)

M. Shamanth, Russel Mathias, Dr Vijayalakshmi MN

摘要:

深度学习方法已被用于创建可能对隐私、民主和国家安全造成威胁的应用程序,并可能被用于进一步放大恶意活动。最近,深度学习驱动的应用之一是名人的合成视频。据《福布斯》报道,生成对抗网络(GANs)生成的虚假视频每年呈指数级增长,被称为Deeptrace的组织估计,从2018年到2019年,deepfakes增加了84%。它们被用来生成和修改人脸,其中大多数现有的假视频都是未经同意的,其中估计约有96%,有些是为了网络犯罪而进行的冒充人格。本文通过识别视频数据集,使用预训练的BlazeFace模型进行人脸检测,并在此基础上训练ResNet和Xception集成架构的神经网络,实现视频中虚假人脸的检测。该模型在损失值和对数损失值上进行优化,并在其F1得分上进行评估。在数据样本上,观察到病灶丢失提供更好的准确性、F1分数和丢失,因为病灶丢失的伽马变成超参数。这在训练周期的峰值处提供了约91%的k折精度,而真实世界的精度随着模型的衰减而随时间变化。

英文摘要:

: Deep learning methodologies have been used to create applications that can cause threats to privacy, democracy and national security and could be used to further amplify malicious activities. One of those deep learning-powered applications in recent times is synthesized videos of famous personalities. According to Forbes, Generative Adversarial Networks(GANs) generated fake videos growing exponentially every year and the organization known as Deeptrace had estimated an increase of deepfakes by 84% from the year 2018 to 2019. They are used to generate and modify human faces, where most of the existing fake videos are of prurient non-consensual nature, of which its estimates to be around 96% and some carried out impersonating personalities for cyber crime. In this paper, available video datasets are identified and a pretrained model BlazeFace is used to detect faces, and a ResNet and Xception ensembled architectured neural network trained on the dataset to achieve the goal of detection of fake faces in videos. The model is optimized over a loss value and log loss values and evaluated over its F1 score. Over a sample of data, it is observed that focal loss provides better accuracy, F1 score and loss as the gamma of the focal loss becomes a hyper parameter. This provides a k-folded accuracy of around 91% at its peak in a training cycle with the real world accuracy subjected to change over time as the model decays.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑