arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.02302eess.AScs.AIcs.SD
收藏

用于受控歌声深度伪造检测(CtrSVDD)挑战赛2024的语音基础模型集成方法

Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024

Vellore Institute of Technology(韦洛尔理工大学)

Anmol Guragain, Tianchi Liu, Zihan Pan, Hardik B. Sailor, Qiongqiong Wang

AI总结:

本文针对2024年歌声深度伪造检测挑战赛,提出基于语音基础模型集成与新颖压缩激励聚合(SEA)方法的反欺骗系统,在CtrSVDD评估集上取得1.79%的领先等错误率。

摘要:

本文详细介绍了我们在受控歌声深度伪造检测(CtrSVDD)评估集上取得1.79%汇总等错误率(EER)领先系统的实现方法。生成式人工智能模型的快速发展给检测AI生成的深度伪造歌声带来了重大挑战,吸引了越来越多的研究关注。歌声深度伪造检测(SVDD)挑战赛2024旨在解决这一复杂任务。在本工作中,我们探索了集成方法,利用语音基础模型构建鲁棒的歌声反欺骗系统。我们还提出了一种新颖的压缩激励聚合(SEA)方法,该方法能够高效且有效地整合来自语音基础模型的表示特征,超越了其他单独系统的性能。评估结果证实了我们的方法在检测深度伪造歌声方面的有效性。代码可在https://github.com/Anmol2059/SVDD2024获取。

英文摘要:

This work details our approach to achieving a leading system with a 1.79% pooled equal error rate (EER) on the evaluation set of the Controlled Singing Voice Deepfake Detection (CtrSVDD). The rapid advancement of generative AI models presents significant challenges for detecting AI-generated deepfake singing voices, attracting increased research attention. The Singing Voice Deepfake Detection (SVDD) Challenge 2024 aims to address this complex task. In this work, we explore the ensemble methods, utilizing speech foundation models to develop robust singing voice anti-spoofing systems. We also introduce a novel Squeeze-and-Excitation Aggregation (SEA) method, which efficiently and effectively integrates representation features from the speech foundation models, surpassing the performance of our other individual systems. Evaluation results confirm the efficacy of our approach in detecting deepfake singing voices. The codes can be accessed at https://github.com/Anmol2059/SVDD2024.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑