语音“克隆”是风格迁移
Voice "Cloning" is Style Transfer
AI总结：
研究发现语音克隆并非忠实复制原声，而是系统性地应用风格迁移，使克隆语音更权威、温暖、客服化且更人性化，导致说话者特征同质化，并影响人类信任与行为。
摘要：
人工生成的语音日益嵌入日常生活。语音克隆尤其适用于身份保留重要的应用，例如完成录音、用新语言配音或保存失语者的声音。然而，在我们的工作中，我们发现尽管术语如此，语音克隆并不能忠实地“克隆”个体的声音。相反，我们发现广泛使用的语音克隆模型系统性地对源语音应用风格迁移。根据人类标注者的评分，克隆语音相比源语音被认为更权威、更温暖、更接近客服风格且更人性化。人类标注者还报告对克隆语音的信任度高于源语音，并且更愿意向它们透露敏感个人信息。我们的工作还表明，语音克隆导致说话者特征的同质化，表现为口音、语速和音频嵌入空间的方差减小。总之，我们的结果凸显了语音克隆技术的一系列新局限和风险，及其对人类行为的潜在影响。
英文摘要：
Artificially generated speech is increasingly embedded in everyday life. Voice cloning in particular enables applications where identity preservation is important, such as completing a recording, dubbing in a new language, or preserving the voices of individuals with speech loss. However, in our work, we find that despite the term, voice cloning does not faithfully ''clone'' an individual's voice. Instead, we find that widely-used voice cloning models systematically apply style transfer to source voices. As rated by human annotators, cloned voices are perceived as more authoritative, warm, customer-service-like, and human-like compared to their sources. Human annotators also report greater trust in cloned voices than source voices, and a greater willingness to disclose sensitive personal information to them. Our work furthermore shows that voice cloning leads to homogenization of speaker characteristics, as measured by reduced variance in accent, speaking rate, and the audio embedding space. Together, our results highlight a new set of limitations and risks of voice cloning technology and their potential impact on human behavior.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
