arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.15775eess.AScs.AIcs.SD
收藏

简单、可解释、有效:用于语音深度伪造检测的 openSMILE

Easy, Interpretable, Effective: openSMILE for voice deepfake detection

Politehnica Bucharest(布加勒斯特理工大学);Fraunhofer AISEC(弗劳恩霍夫AISEC研究院)

Octavian Pascu, Dan Oneata, Horia Cucu, Nicolas M. Müller

AI总结:

本文利用 openSMILE 提取的简单可解释标量特征,在 ASVspoof5 数据集上实现低至 0.8% 的 EER,并发现特征在相似 TTS 架构的攻击间可迁移,表明语音反欺骗部分可归结为识别 TTS 系统指纹。

摘要:

在本文中,我们证明了最新的 ASVspoof5 数据集——语音真实性与深度伪造检测领域的事实标准——中的攻击可以通过一小部分非常简单的特征以惊人的准确率被识别出来。这些特征源自 openSMILE 库,具有标量值、易于计算且人类可解释的特点。例如,攻击 A10 的清音段平均长度为 0.09 ± 0.02,而真实样本的平均长度为 0.18 ± 0.07。仅使用这一特征,阈值分类器对攻击 A10 的等错误率(EER)达到 10.3%。类似地,在所有攻击上,我们实现了低至 0.8% 的 EER,总体 EER 为 15.7 ± 6.0%。我们探索了这些特征的泛化能力,发现其中一些特征在攻击之间能够有效迁移,尤其是当攻击源自相似的文本到语音(TTS)架构时。这一发现可能表明,语音反欺骗在一定程度上是一个识别和记忆单个 TTS 系统签名或指纹的问题。这有助于更好地理解反欺骗模型及其在实际应用中面临的挑战。

英文摘要:

In this paper, we demonstrate that attacks in the latest ASVspoof5 dataset -- a de facto standard in the field of voice authenticity and deepfake detection -- can be identified with surprising accuracy using a small subset of very simplistic features. These are derived from the openSMILE library, and are scalar-valued, easy to compute, and human interpretable. For example, attack A10`s unvoiced segments have a mean length of 0.09 +- 0.02, while bona fide instances have a mean length of 0.18 +- 0.07. Using this feature alone, a threshold classifier achieves an Equal Error Rate (EER) of 10.3% for attack A10. Similarly, across all attacks, we achieve up to 0.8% EER, with an overall EER of 15.7 +- 6.0%. We explore the generalization capabilities of these features and find that some of them transfer effectively between attacks, primarily when the attacks originate from similar Text-to-Speech (TTS) architectures. This finding may indicate that voice anti-spoofing is, in part, a problem of identifying and remembering signatures or fingerprints of individual TTS systems. This allows to better understand anti-spoofing models and their challenges in real-world application.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑