arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.09667cs.HCcs.AIcs.SDeess.AS
收藏

人类对音频深度伪造的感知

Human Perception of Audio Deepfakes

Fraunhofer AISEC(弗劳恩霍夫AISEC);TU Munich(慕尼黑工业大学);University of Southampton(南安普顿大学)

Nicolas M. Müller, Karla Pizzi, Jennifer Williams

AI总结:

本文通过基于Web的游戏框架对比了人类与AI在检测音频深度伪造上的能力,发现两者表现相近且均难防特定攻击,并揭示了母语者和年轻人更具优势,为未来网络安全培训和算法开发提供了参考。

摘要:

近期深度伪造的出现将操纵和生成内容推向了机器学习研究的前沿。深度伪造的自动检测催生了许多新的机器学习技术,然而,人类的检测能力却鲜少被探索。在本文中,我们展示了比较人类与机器在检测用于模仿他人声音的音频深度伪造方面的能力的结果。为此,我们使用了一个以游戏形式构建的基于Web的应用程序框架。参与者被要求区分真实和伪造的音频样本。在我们的实验中,472名独立用户与最先进的AI深度伪造检测算法进行了总计14912轮游戏的对抗。我们发现,人类与深度伪造检测算法具有相似的优缺点,两者都难以检测某些类型的攻击。这与AI在目标检测或人脸识别等许多应用领域中的超人表现形成对比。关于人类成功的因素,我们发现IT专业人士相比非专业人士没有优势,但母语者相比非母语者具有优势。此外,我们发现年龄较大的参与者往往比年龄较小的更容易受骗。这些见解在设计面向人类的未来网络安全培训以及开发更好的检测算法时可能会有所帮助。

英文摘要:

The recent emergence of deepfakes has brought manipulated and generated content to the forefront of machine learning research. Automatic detection of deepfakes has seen many new machine learning techniques, however, human detection capabilities are far less explored. In this paper, we present results from comparing the abilities of humans and machines for detecting audio deepfakes used to imitate someone's voice. For this, we use a web-based application framework formulated as a game. Participants were asked to distinguish between real and fake audio samples. In our experiment, 472 unique users competed against a state-of-the-art AI deepfake detection algorithm for 14912 total of rounds of the game. We find that humans and deepfake detection algorithms share similar strengths and weaknesses, both struggling to detect certain types of attacks. This is in contrast to the superhuman performance of AI in many application areas such as object detection or face recognition. Concerning human success factors, we find that IT professionals have no advantage over non-professionals but native speakers have an advantage over non-native speakers. Additionally, we find that older participants tend to be more susceptible than younger ones. These insights may be helpful when designing future cybersecurity training for humans as well as developing better detection algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑