arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.21164cs.SD
收藏

MAGIC-TTS:具有显式局部持续时间和停顿控制的细粒度可控语音合成

MAGIC-TTS: Fine-Grained Controllable Speech Synthesis with Explicit Local Duration and Pause Control

South China University of Technology(华南理工大学)

Jialong Mai, Xiaofen Xing, Xiangmin Xu

AI总结:

MAGIC-TTS通过显式token级持续时间控制和停顿控制,实现了细粒度可控的语音合成,提升了合成质量并支持实际局部编辑应用。

摘要:

细粒度局部时间控制仍缺失于现代文本到语音系统:现有方法通常仅提供句子级持续时间或全局语速控制,而精确的token级时间操控仍不可用。据我们所知,MAGIC-TTS是首个具有显式局部时间控制的TTS模型,能够对token级内容持续时间和停顿进行显式控制。MAGIC-TTS通过显式token级持续时间条件、精心准备的高置信度持续时间监督以及纠正零值偏差并使模型对缺失局部控制具有鲁棒性的训练机制实现。在我们的时间控制基准测试中,MAGIC-TTS在自发合成中显著提高了token级持续时间和停顿跟随。即使在没有时间控制的情况下,MAGIC-TTS也能维持自然高质量的合成。我们进一步评估了实际的局部编辑,通过涵盖导航指导、引导阅读和面向可访问性的代码阅读的场景基准进行评估。在此设置中,MAGIC-TTS实现了可重复的统一时间基准,然后将编辑区域向请求的局部目标移动,具有低均值偏差。这些结果表明,显式的细粒度可控性可以有效实现于高质量的TTS系统中,并能支持实际的局部时间编辑应用。

英文摘要:

Fine-grained local timing control is still absent from modern text-to-speech systems: existing approaches typically provide only utterance-level duration or global speaking-rate control, while precise token-level timing manipulation remains unavailable. To the best of our knowledge, MAGIC-TTS is the first TTS model with explicit local timing control over token-level content duration and pause. MAGIC-TTS is enabled by explicit token-level duration conditioning, carefully prepared high-confidence duration supervision, and training mechanisms that correct zero-value bias and make the model robust to missing local controls. On our timing-control benchmark, MAGIC-TTS substantially improves token-level duration and pause following over spontaneous synthesis. Even when no timing control is provided, MAGIC-TTS maintains natural high-quality synthesis. We further evaluate practical local editing with a scenario-based benchmark covering navigation guidance, guided reading, and accessibility-oriented code reading. In this setting, MAGIC-TTS realizes a reproducible uniform-timing baseline and then moves the edited regions toward the requested local targets with low mean bias. These results show that explicit fine-grained controllability can be implemented effectively in a high-quality TTS system and can support realistic local timing-editing applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑