SoulX-Podcast：迈向具备方言与副语言多样性的逼真长播客
SoulX-Podcast: Towards Realistic Long-form Podcasts with Dialectal and Paralinguistic Diversity
AI总结：
针对现有TTS系统多说话人对话生成能力不足的问题，提出集成副语言控制、支持多语言及方言的SoulX-Podcast系统，可生成90分钟以上稳定流畅的多轮对话，在独白与对话合成任务上均达SOTA。
摘要：
文本转语音（TTS）合成技术的最新进展显著提升了语音的表现力与自然度。然而，现有大多数系统专为单说话人合成定制，在生成连贯的多说话人对话语音方面存在不足。本技术报告介绍SoulX-Podcast，这是一款专为播客风格的多轮、多说话人对话语音生成设计的系统，同时在传统TTS任务中也达到了当前最优性能。为满足多轮口语对话更高的自然度要求，SoulX-Podcast集成了一系列副语言控制功能，支持普通话、英语以及四川话、河南话、粤语等多种汉语方言，可实现更具个性化的播客风格语音生成。实验结果表明，SoulX-Podcast能够连续生成超过90分钟的对话，说话人音色稳定，说话人切换流畅。此外，说话人表现出随语境自适应的韵律，反映出对话推进过程中自然的节奏与语调变化。在多项评估指标上，SoulX-Podcast在独白TTS和多轮对话语音合成两个任务中均达到了当前最优性能。
英文摘要：
Recent advances in text-to-speech (TTS) synthesis have significantly improved speech expressiveness and naturalness. However, most existing systems are tailored for single-speaker synthesis and fall short in generating coherent multi-speaker conversational speech. This technical report presents SoulX-Podcast, a system designed for podcast-style multi-turn, multi-speaker dialogic speech generation, while also achieving state-of-the-art performance in conventional TTS tasks. To meet the higher naturalness demands of multi-turn spoken dialogue, SoulX-Podcast integrates a range of paralinguistic controls and supports both Mandarin and English, as well as several Chinese dialects, including Sichuanese, Henanese, and Cantonese, enabling more personalized podcast-style speech generation. Experimental results demonstrate that SoulX-Podcast can continuously produce over 90 minutes of conversation with stable speaker timbre and smooth speaker transitions. Moreover, speakers exhibit contextually adaptive prosody, reflecting natural rhythm and intonation changes as dialogues progress. Across multiple evaluation metrics, SoulX-Podcast achieves state-of-the-art performance in both monologue TTS and multi-turn conversational speech synthesis.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
