arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.04865cs.SD
收藏

环境声音深度伪造检测挑战赛:鲁棒性、评估与洞察的基准测试

The First Environmental Sound Deepfake Detection Challenge: Benchmarking Robustness, Evaluation, and Insights

School of Electrical Engineering, KAIST, Daejeon, Republic of Korea(韩国成均馆大学电气工程学院);University of Melbourne, Australia(墨尔本大学);Fortemedia Singapore, Singapore(新加坡Fortemedia公司);Xi’an University of Posts & Telecommunications, Xi’an, China(西安邮电大学);Xi'an Lianfeng Acoustic Technologies Co., Ltd., China(西安联丰声学技术有限公司)

Han Yin, Yang Xiao, Rohan Kumar Das, Jisheng Bai, Ting Dang

AI总结:

本文介绍了环境声音深度伪造检测挑战赛,探讨了鲁棒性评估、系统架构及未来研究方向,提出了环境声音深度伪造检测的关键挑战与机遇。

摘要:

近年来,音频生成技术的进步使得创建高度逼真的环境声音景观变得更加容易,这可能被滥用于制造欺骗性内容,如假警报、枪声和人群声音,从而引发公众安全和信任的担忧。尽管语音和歌唱声的深度伪造检测已被广泛研究,但环境声音深度伪造检测(ESDD)仍处于探索阶段。为了推动ESDD的发展,首次ESDD挑战赛被启动,吸引了97支注册团队,收到了1748份有效提交。本文提出了该任务的定义、数据集构建、评估协议、基线系统以及挑战赛结果中的关键见解。此外,我们分析了高性能系统中常见的架构选择和训练策略。最后,我们讨论了ESDD的潜在未来研究方向,概述了关键机会和开放问题,以指导该领域后续研究。

英文摘要:

Recent progress in audio generation has made it increasingly easy to create highly realistic environmental soundscapes, which can be misused to produce deceptive content, such as fake alarms, gunshots, and crowd sounds, raising concerns for public safety and trust. While deepfake detection for speech and singing voice has been extensively studied, environmental sound deepfake detection (ESDD) remains underexplored. To advance ESDD, the first edition of the ESDD challenge was launched, attracting 97 registered teams and receiving 1,748 valid submissions. This paper presents the task formulation, dataset construction, evaluation protocols, baseline systems, and key insights from the challenge results. Furthermore, we analyze common architectural choices and training strategies among top-performing systems. Finally, we discuss potential future research directions for ESDD, outlining key opportunities and open problems to guide subsequent studies in this field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑