arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.01482eess.AScs.AIcs.LGeess.SP
收藏

一种用于音频深度伪造检测的自监督语音模型基准

A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detection

Electrical and Computer Engineering University of Michigan(密歇根大学电气与计算机工程系)

Hashim Ali, Nithin Sai Adupa, Surya Subramani, Hafiz Malik

AI总结:

本文提出Spoof-SUPERB基准,评估20种自监督语音模型在音频深度伪造检测中的性能,发现大规模判别模型在多语言预训练和说话人感知目标下表现更优。

摘要:

自监督学习(SSL)已革新语音处理,SUPERB等基准为不同下游任务提供了公平比较。尽管其在安全领域至关重要,音频深度伪造检测仍未被纳入。本文引入Spoof-SUPERB基准,系统评估20种自监督语音模型,涵盖生成、判别和频谱基架构。我们评估了这些模型在多个领域内和外数据集上的表现。结果表明,大规模判别模型如XLS-R、UniSpeech-SAT和WavLM Large在多语言预训练、说话人感知目标和模型规模方面表现更优。我们进一步分析了这些模型在声学退化下的鲁棒性,显示生成方法退化显著,而判别模型保持稳健。该基准建立了可重复的基线,并提供了关于哪些SSL表示最可靠用于保护语音系统免受音频深度伪造攻击的实用见解。

英文摘要:

Self-supervised learning (SSL) has transformed speech processing, with benchmarks such as SUPERB establishing fair comparisons across diverse downstream tasks. Despite it's security-critical importance, Audio deepfake detection has remained outside these efforts. In this work, we introduce Spoof-SUPERB, a benchmark for audio deepfake detection that systematically evaluates 20 SSL models spanning generative, discriminative, and spectrogram-based architectures. We evaluated these models on multiple in-domain and out-of-domain datasets. Our results reveal that large-scale discriminative models such as XLS-R, UniSpeech-SAT, and WavLM Large consistently outperform other models, benefiting from multilingual pretraining, speaker-aware objectives, and model scale. We further analyze the robustness of these models under acoustic degradations, showing that generative approaches degrade sharply, while discriminative models remain resilient. This benchmark establishes a reproducible baseline and provides practical insights into which SSL representations are most reliable for securing speech systems against audio deepfakes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑