arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.02438eess.AScs.MMcs.SD

CtrSVDD:面向受控歌唱语音深度伪造检测的基准数据集与基线分析

CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection

University of Rochester(罗切斯特大学);Carnegie Mellon University(卡内基梅隆大学);Nagoya University(名古屋大学);Renmin University of China(中国人民大学)

Yongyi Zang, Jiatong Shi, You Zhang, Ryuichi Yamamoto, Jionghao Han, Yuxun Tang, Shengyuan Xu, Wenxiao Zhao, Jing Guo, Tomoki Toda, Zhiyao Duan

AI总结:

针对现有歌唱语音深度伪造检测数据集在受控性、多样性和许可上的局限,本文提出大规模基准数据集CtrSVDD及基线系统,实验揭示了特征选择与泛化能力的重要性。

摘要:

近期歌唱语音合成与转换的进展需要鲁棒的歌唱语音深度伪造检测(SVDD)模型。由于受控性有限、深度伪造方法多样性及许可限制,当前的SVDD数据集面临挑战。为弥补这些不足,我们引入了CtrSVDD,一个大规模、多样化的真实与伪造歌唱语音集合。这些语音使用公开歌唱语音数据集中最先进的方法合成。CtrSVDD包含47.64小时真实和260.34小时伪造歌唱语音,涵盖14种深度伪造方法和164个歌手身份。我们还提出了具有灵活前端特征的基线系统,并在结构化的训练/开发/评估划分上进行评估。实验表明特征选择的重要性,并凸显了对偏离训练分布较远的深度伪造方法泛化能力的需求。

英文摘要:

Recent singing voice synthesis and conversion advancements necessitate robust singing voice deepfake detection (SVDD) models. Current SVDD datasets face challenges due to limited controllability, diversity in deepfake methods, and licensing restrictions. Addressing these gaps, we introduce CtrSVDD, a large-scale, diverse collection of bonafide and deepfake singing vocals. These vocals are synthesized using state-of-the-art methods from publicly accessible singing voice datasets. CtrSVDD includes 47.64 hours of bonafide and 260.34 hours of deepfake singing vocals, spanning 14 deepfake methods and involving 164 singer identities. We also present a baseline system with flexible front-end features, evaluated against a structured train/dev/eval split. The experiments show the importance of feature selection and highlight a need for generalization towards deepfake methods that deviate further from training distribution. The CtrSVDD dataset and baselines are publicly accessible.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑