arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2506.14226cs.SD

用于增强短语音说话人验证的零样本文本转语音模型研究

Investigation of Zero-shot Text-to-Speech Models for Enhancing Short-Utterance Speaker Verification

Tsinghua University(清华大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);University of Cambridge(剑桥大学)

Yiyang Zhao, Shuai Wang, Guangzhi Sun, Zehua Chen, Chao Zhang, Mingxing Xu, Thomas Fang Zheng

AI总结:

本研究首次探索将零样本文本转语音系统用于短语音说话人验证的测试时数据增强,在VoxCeleb 1数据集上实验证实可显著降低等错误率,同时指出合成语音的局限性,为相关研究提供参考。

摘要:

短语音说话人验证因简短语音片段中的信息有限而面临重大挑战,这会损害其准确性和可靠性。近年来,零样本文本转语音(ZS-TTS)系统在保留说话人身份方面取得了长足进展。在本研究中,我们首次探索将ZS-TTS系统用于说话人验证的测试时数据增强。我们在VoxCeleb 1数据集上评估了三种最先进的预训练ZS-TTS系统:NatureSpeech 3、CosyVoice和MaskGCT。我们的实验结果表明,将真实和合成语音样本相结合,可在所有时长下实现10%-16%的相对等错误率(EER)降低,其中短语音的提升尤为显著,且所有过程均无需重新训练任何现有系统。然而,我们的分析显示,较长的合成语音在降低EER方面无法带来与较长真实语音相同的益处。这些发现凸显了使用ZS-TTS进行测试时说话人验证的潜力与挑战,为未来研究提供了见解。

英文摘要:

Short-utterance speaker verification presents significant challenges due to the limited information in brief speech segments, which can undermine accuracy and reliability. Recently, zero-shot text-to-speech (ZS-TTS) systems have made considerable progress in preserving speaker identity. In this study, we explore, for the first time, the use of ZS-TTS systems for test-time data augmentation for speaker verification. We evaluate three state-of-the-art pre-trained ZS-TTS systems, NatureSpeech 3, CosyVoice, and MaskGCT, on the VoxCeleb 1 dataset. Our experimental results show that combining real and synthetic speech samples leads to 10%-16% relative equal error rate (EER) reductions across all durations, with particularly notable improvements for short utterances, all without retraining any existing systems. However, our analysis reveals that longer synthetic speech does not yield the same benefits as longer real speech in reducing EERs. These findings highlight the potential and challenges of using ZS-TTS for test-time speaker verification, offering insights for future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑