Recent advances in Text-to-Speech (TTS) and Voice-Conversion (VC) using generative Artificial Intelligence (AI) technology have made it possible to generate high-quality and realistic human-like audio. This poses growing challenges in distinguishing AI-synthesized speech from the genuine human voice and could raise concerns about misuse for impersonation, fraud, spreading misinformation, and scams. However, existing detection methods for AI-synthesized audio have not kept pace and often fail to generalize across diverse datasets. In this paper, we introduce SONAR, a synthetic AI-Audio Detection Framework and Benchmark, aiming to provide a comprehensive evaluation for distinguishing cutting-edge AI-synthesized auditory content. SONAR includes a novel evaluation dataset sourced from 9 diverse audio synthesis platforms, including leading TTS providers and state-of-the-art TTS models. It is the first framework to uniformly benchmark AI-audio detection across both traditional and foundation model-based detection systems. Through extensive experiments, (1) we reveal the limitations of existing detection methods and demonstrate that foundation models exhibit stronger generalization capabilities, likely due to their model size and the scale and quality of pretraining data. (2) Speech foundation models demonstrate robust cross-lingual generalization capabilities, maintaining strong performance across diverse languages despite being fine-tuned solely on English speech data. This finding also suggests that the primary challenges in audio deepfake detection are more closely tied to the realism and quality of synthetic audio rather than language-specific characteristics. (3) We explore the effectiveness and efficiency of few-shot fine-tuning in improving generalization, highlighting its potential for tailored applications, such as personalized detection systems for specific entities or individuals.
Generalized Source Tracing: Detecting Novel Audio Deepfake Algorithm with Real Emphasis and Fake Dispersion Strategy
Communication University of China(中国传媒大学);Chinese Academy of Sciences(中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Tsinghua University(清华大学)
Audio Deepfake Attribution: An Initial Dataset and Investigation
School of Electronics and Information Engineering, Beihang University(北京航空航天大学电子信息工程学院);Tsinghua University(清华大学);National Research Center for Information Science and Technology, Tsinghua University(清华大学国家信息科学与技术研究中心)
Fraunhofer AISEC(弗劳恩霍夫人工智能安全研究所);Wrocław University of Science and Technology(沃斯克拉大学科学与技术学院);Resemble AI(Resemble AI公司);Technical University of Cluj-Napoca(克鲁克斯-纳波卡技术大学);Neodyme AG(Neodyme公司);TU Munich(慕尼黑技术大学)
AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plan
Communication University of China(中国传媒大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Institute of Technology(北京理工大学);Shanghai Jiao Tong University(上海交通大学)
ADD 2023: the Second Audio Deepfake Detection Challenge
Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学);The Chinese University of Hong Kong(香港中文大学)
Targeted Augmented Data for Audio Deepfake Detection
Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg(卢森堡大学跨学科安全、可靠性与信任中心(SnT));Cristal Laboratory, National School of Computer Sciences (ENSI), Manouba University(马努巴大学计算机科学国家学院(ENSI)克里斯塔尔实验室)
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);Beijing Jiaotong University(北京交通大学);Hebei University of Technology(河北工业大学)
Gender Fairness in Audio Deepfake Detection: Performance and Disparity Analysis
School of Computing, Wichita State University(维斯科大学计算学院);Institut national de la recherche scientifique (INRS–EMT)(国家科学研究中心(INRS–EMT));INRS-UQO Mixed Research Unit on Cybersecurity(网络安全混合研究单位(INRS-UQO))
Investigating the Viability of Employing Multi-modal Large Language Models in the Context of Audio Deepfake Detection
Indian Institute of Technology, Ropar, India(印度理工学院罗帕尔分校);Machine Intelligence Group, Birla Institute of Technology and Science, Pilani, Hyderabad Campus, India(比拉理工科学院帕利尼 Hyderabad 分校机器智能小组);Monash University, Melbourne, Australia(墨尔本大学)
RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Tsinghua University(清华大学)