With the advancement of audio generation, generative models can produce highly realistic audios. However, the proliferation of deepfake general audio can pose negative consequences. Therefore, we propose a new task, deepfake general audio detection, which aims to identify whether audio content is manipulated and to locate deepfake regions. Leveraging an automated manipulation pipeline, a dataset named FakeSound for deepfake general audio detection is proposed, and samples can be viewed on website https://FakeSoundData.github.io. The average binary accuracy of humans on all test sets is consistently below 0.6, which indicates the difficulty humans face in discerning deepfake audio and affirms the efficacy of the FakeSound dataset. A deepfake detection model utilizing a general audio pre-trained model is proposed as a benchmark system. Experimental results demonstrate that the performance of the proposed model surpasses the state-of-the-art in deepfake speech detection and human testers.
Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；School of Information and Communication Engineering, Communication University of China（中国传媒大学信息与通信工程学院）；Department of Automation, Tsinghua University（清华大学自动化系）；Beijing National Research Center for Information Science and Technology, Tsinghua University（清华大学北京信息科学与技术国家研究中心）；Shanghai Polytechnic University（上海第二工业大学）
Hindi audio-video-Deepfake (HAV-DF): A Hindi language-based Audio-video Deepfake Dataset
BML Munjal University（BML蒙贾尔大学）；School of Engineering & Technology, BML Munjal University（BML蒙贾尔大学工程与技术学院）；Center for Advanced Data and Computational Science, BML Munjal University（BML蒙贾尔大学高级数据与计算科学中心）
Zero-Shot to Zero-Lies: Detecting Bengali Deepfake Audio through Transfer Learning
Department of CSE, BRAC University, Bangladesh（布鲁斯大学计算机科学与工程系）；Department of CSE, Ahsanullah University of Science and Technology, Bangladesh（阿沙努拉科技大学计算机科学与工程系）；Enosis Solutions, Bangladesh（恩奥斯解决方案公司）；Department of CSE, Southeast University, Bangladesh（东南大学计算机科学与工程系）
Enkidu: Universal Frequential Perturbation for Real-Time Audio Privacy Protection against Voice Deepfakes
College of Computer Science；Technology, Zhejiang University Hangzhou China；School of Big Data \& Software Engineering, Chongqing University Chongqing China；Technology, Zhejiang University；School of Big Data \& Software Engineering, Chongqing University
This paper describes our submitted systems to the 2022 ADD challenge withing the tracks 1 and 2. Our approach is based on the combination of a pre-trained wav2vec2 feature extractor and a downstream classifier to detect spoofed audio. This method exploits the contextualized speech representations at the different transformer layers to fully capture discriminative information. Furthermore, the classification model is adapted to the application scenario using different data augmentation techniques. We evaluate our system for audio synthesis detection in both the ASVspoof 2021 and the 2022 ADD ch…
ADD 2023: the Second Audio Deepfake Detection Challenge
Peoples' Friendship University of Russia (RUDN University)（俄罗斯人民友谊大学（RUDN大学））；Joint Institute for Nuclear Research（联合核研究所）；Vrije Universiteit Amsterdam（阿姆斯特丹自由大学）；University of Skövde（舍夫德大学）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Tsinghua University（清华大学）；National University of Singapore（新加坡国立大学）；The Chinese University of Hong Kong（香港中文大学）
Does Current Deepfake Audio Detection Model Effectively Detect ALM-based Deepfake Audio?
Communication University of China（中国传媒大学）；SDU-ANU Joint Science College, Shandong University（山东大学-澳大利亚国立大学联合科学学院）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Tsinghua University（清华大学）；Beijing National Research Center for Information Science and Technology, Tsinghua University（北京信息科学与技术国家研究中心（清华大学））
Deepfake is content or material that is generated or manipulated using AI methods, to pass off as real. There are four different deepfake types: audio, video, image and text. In this research we focus on audio deepfakes and how people perceive it. There are several audio deepfake generation frameworks, but we chose MelGAN which is a non-autoregressive and fast audio deepfake generating framework, requiring fewer parameters. This study tries to assess audio deepfake perceptions among college students from different majors. This study also answers the question of how their background and major c…
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Tsinghua University（清华大学）；University of Science and Technology of China（中国科学技术大学）；Beijing Jiaotong University（北京交通大学）；Hebei University of Technology（河北工业大学）
University of Maryland Baltimore County（马里兰大学巴尔的摩郡分校）
Deepfake is content or material that is synthetically generated or manipulated using artificial intelligence (AI) methods, to be passed off as real and can include audio, video, image, and text synthesis. This survey has been conducted with a different perspective compared to existing survey papers, that mostly focus on just video and image deepfakes. This survey not only evaluates generation and detection methods in the different deepfake categories, but mainly focuses on audio deepfakes that are overlooked in most of the existing surveys. This paper critically analyzes and provides a unique …
RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection
School of Computer Science and Technology, Anhui University（安徽大学计算机科学与技术学院）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Tsinghua University（清华大学）
Boundary and Intra-Segment Learning for Partial Audio Deepfake Localization
Sun Yat-sen University（中山大学）；China Mobile Internet Corporation（中国移动互联网公司）；The Hong Kong Polytechnic University（香港理工大学）；Nanyang Technological University（南洋理工大学）
Targeted Augmented Data for Audio Deepfake Detection
Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg（卢森堡大学跨学科安全、可靠性与信任中心（SnT））；Cristal Laboratory, National School of Computer Sciences (ENSI), Manouba University（马努巴大学计算机科学国家学院（ENSI）克里斯塔尔实验室）
While the significant advancements have made in the generation of deepfakes using deep learning technologies, its misuse is a well-known issue now. Deepfakes can cause severe security and privacy issues as they can be used to impersonate a person's identity in a video by replacing his/her face with another person's face. Recently, a new problem of generating synthesized human voice of a person is emerging, where AI-based deep learning models can synthesize any person's voice requiring just a few seconds of audio. With the emerging threat of impersonation attacks using deepfake audios and video…
Generalized Source Tracing: Detecting Novel Audio Deepfake Algorithm with Real Emphasis and Fake Dispersion Strategy
Communication University of China（中国传媒大学）；Chinese Academy of Sciences（中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Tsinghua University（清华大学）
Audio Deepfake Attribution: An Initial Dataset and Investigation
School of Electronics and Information Engineering, Beihang University（北京航空航天大学电子信息工程学院）；Tsinghua University（清华大学）；National Research Center for Information Science and Technology, Tsinghua University（清华大学国家信息科学与技术研究中心）
The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio
State Key Laboratory of Media Convergence and Communication（媒体融合与传播国家重点实验室）；School of Data Science and Intelligent Media, Communication University of China（中国传媒大学数据科学与智能媒体学院）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Department of Automation, Tsinghua University（清华大学自动化系）；Beijing National Research Center for Information Science and Technology, Tsinghua University（清华大学北京信息科学与技术国家研究中心）；School of Cyberspace science and Technology, Beijing Institute of Technology（北京理工大学网络空间科学与技术学院）
Wrocław University of Science and Technology（弗罗茨瓦夫科技大学）
Audio DeepFakes are utterances generated with the use of deep neural networks. They are highly misleading and pose a threat due to use in fake news, impersonation, or extortion. In this work, we focus on increasing accessibility to the audio DeepFake detection methods by providing SpecRNet, a neural network architecture characterized by a quick inference time and low computational requirements. Our benchmark shows that SpecRNet, requiring up to about 40% less time to process an audio sample, provides performance comparable to LCNN architecture - one of the best audio DeepFake detection models.…
