VoiceCraft-X：统一多语言、语音克隆的语音合成与语音编辑
VoiceCraft-X: Unifying Multilingual, Voice-Cloning Speech Synthesis and Speech Editing
AI总结：
本文提出自回归神经编解码语言模型VoiceCraft-X，基于Qwen3和token重排机制统一11种语言的零样本TTS与语音编辑任务，在低资源语言场景下仍能生成高质量自然语音。
摘要：
我们推出VoiceCraft-X，这是一款自回归神经编解码语言模型，可统一支持11种语言（英语、普通话、韩语、日语、西班牙语、法语、德语、荷兰语、意大利语、葡萄牙语、波兰语）的多语言语音编辑与零样本文本转语音（TTS）合成任务。VoiceCraft-X采用Qwen3大语言模型实现无音素跨语言文本处理，还引入具备时间对齐文本与语音token的新型token重排机制，将两类任务统一为单序列生成问题处理。该模型可生成高质量、听感自然的语音，能在同一框架内无缝生成新音频或编辑已有录音。即便单语言数据有限，VoiceCraft-X在多样语言场景下仍表现稳健，彰显了统一自回归方法在推进复杂真实世界多语言语音应用方面的潜力，音频样例可访问https://zhishengzheng.com/voicecraft-x/获取。
英文摘要：
We introduce VoiceCraft-X, an autoregressive neural codec language model which unifies multilingual speech editing and zero-shot Text-to-Speech (TTS) synthesis across 11 languages: English, Mandarin, Korean, Japanese, Spanish, French, German, Dutch, Italian, Portuguese, and Polish. VoiceCraft-X utilizes the Qwen3 large language model for phoneme-free cross-lingual text processing and a novel token reordering mechanism with time-aligned text and speech tokens to handle both tasks as a single sequence generation problem. The model generates high-quality, natural-sounding speech, seamlessly creating new audio or editing existing recordings within one framework. VoiceCraft-X shows robust performance in diverse linguistic settings, even with limited per-language data, underscoring the power of unified autoregressive approaches for advancing complex, real-world multilingual speech applications. Audio samples are available at https://zhishengzheng.com/voicecraft-x/.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
