音频人像指纹：在合成音频时代授权使用语音克隆的方法
Audio Avatar Fingerprinting: An Approach for Authorized Use of Voice Cloning in the Era of Synthetic Audio
AI总结：
本文提出音频人像指纹技术，用于验证合成语音是否由授权身份生成，通过扩展现有说话人验证模型并引入新数据集解决合成语音授权使用验证问题。
摘要：
随着AI语音合成技术的进步，生成逼真目标语音变得前所未有的容易。只需几秒钟的目标语音参考音频，便可将话语放入目标人物口中。这给基于语音的身份认证系统、视频会议和音频视频广播平台带来了新的鉴证挑战，需要检测合成语音。同时，利用AI语音合成可通过低带宽通信和音频增强等特性提升通信方式，导致合成音频的合法使用案例不断增加。在此背景下，我们需要验证合成语音是否确实由用户发出。这需要一种机制来验证给定的合成音频是否由授权身份驱动。我们将其称为音频人像指纹。作为在这些新出现情境中音频鉴证的一步，我们分析并扩展了一个非鉴证背景下开发的说话人验证模型，用于假语音检测和音频人像指纹任务，这是首次此类实验。此外，我们观察到现有数据集无法支持验证合成音频授权使用的新任务，我们通过引入新的语音鉴证数据集来解决这一限制。
英文摘要：
With the advancements in AI speech synthesis, it is easier than ever before to generate realistic audio in a target voice. One only needs a few seconds of reference audio from the target, quite literally putting words in the target person's mouth. This imposes a new set of forensics-related challenges on speech-based authentication systems, videoconferencing, and audio-visual broadcasting platforms, where we want to detect synthetic speech. At the same time, leveraging AI speech synthesis can enhance the different modes of communication through features such as low-bandwidth communication and audio enhancements - leading to ever-increasing legitimate use-cases of synthetic audio. In this case, we want to verify if the synthesized voice is actually spoken by the user. This will require a mechanism to verify whether a given synthetic audio is driven by an authorized identity, or not. We term this task audio avatar fingerprinting. As a step towards audio forensics in these new and emerging situations, we analyze and extend an off-the-shelf speaker verification model developed outside of forensics context for the task of fake speech detection and audio avatar fingerprinting, the first experimentation of its kind. Furthermore, we observe that no existing dataset allows for the novel task of verifying the authorized use of synthetic audio - a limitation which we address by introducing a new speech forensics dataset for this novel task.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
