arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.13049eess.AScs.CVcs.MMcs.SD
收藏

DiffSSD:一个用于语音取证的基于扩散的数据集

DiffSSD: A Diffusion-Based Dataset For Speech Forensics

School of Electrical and Computer Engineering, Purdue University(普渡大学电气与计算机工程学院);Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano(米兰理工大学电子、信息与生物工程系)

Kratika Bhagtani, Amit Kumar Singh Yadav, Paolo Bestagini, Edward J. Delp

AI总结:

针对现有检测器难以识别扩散模型生成语音的问题,本文构建含约200小时、来自8个开源与2个商业扩散生成器语音的DiffSSD数据集,并验证其在闭集和开集检测中的价值。

摘要:

基于扩散的语音生成器如今无处不在。这些方法能够生成非常高质量的合成语音,并且近期多起事件报告了它们的恶意使用。为了应对此类滥用,研究人员开发了合成语音检测器。许多此类检测器是在不包含基于扩散合成器的数据集上训练的。本文证明,在ASVspoof2019这一数据集上训练的现有检测器,在检测来自近期基于扩散合成器的合成语音时表现不佳。我们提出了基于扩散的合成语音数据集(DiffSSD),该数据集包含约200小时带标签语音,其中包括由8个基于扩散的开源生成器和2个商业生成器生成的合成语音。我们还在闭集和开集两种场景下检验了现有合成语音检测器在DiffSSD上的性能。结果凸显了该数据集对于检测由近期开源和商业语音生成器生成的合成语音的重要性。

英文摘要:

Diffusion-based speech generators are ubiquitous. These methods can generate very high quality synthetic speech and several recent incidents report their malicious use. To counter such misuse, synthetic speech detectors have been developed. Many of these detectors are trained on datasets which do not include diffusion-based synthesizers. In this paper, we demonstrate that existing detectors trained on one such dataset, ASVspoof2019, do not perform well in detecting synthetic speech from recent diffusion-based synthesizers. We propose the Diffusion-Based Synthetic Speech Dataset (DiffSSD), a dataset consisting of about 200 hours of labeled speech, including synthetic speech generated by 8 diffusion-based open-source and 2 commercial generators. We also examine the performance of existing synthetic speech detectors on DiffSSD in both closed-set and open-set scenarios. The results highlight the importance of this dataset in detecting synthetic speech generated from recent open-source and commercial speech generators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑