arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2408.12170cs.HCcs.SDeess.AS

VoiceX:一个用于自定义声音的文本转语音框架

VoiceX: A Text-To-Speech Framework for Custom Voices

Augsburg University(奥格斯堡大学);Chair for Human-Centerd Artificial Intelligence(以人为中心人工智能讲席)

Silvan Mertes, Daksitha Withanage Don, Otto Grothe, Johanna Kuch, Ruben Schlagowski, Elisabeth André

AI总结:

针对深度学习TTS模型参数空间庞大且不可解释导致手动自定义声音困难的问题,提出基于进化算法的人在回路范式与图形界面VoiceX,支持高效创建个性化自定义声音并提供Python API。

摘要:

现代TTS系统能够创建高度逼真且听起来自然的语音。尽管有这些进展,自定义TTS声音的过程仍然是一项复杂的任务,通常需要该领域专家的专业知识。其中一个原因是深度学习模型的使用,其特征是庞大的、不可解释的参数空间,限制了手动自定义的可行性。在本文中,我们提出了一种基于进化算法的新型人在回路范式,用于直接与神经TTS模型的参数空间进行交互。我们将该方法集成到一个用户友好的图形用户界面中,允许用户高效地创建原创声音。这些声音随后可以与骨干TTS模型一起使用,我们为此提供了一个Python API。此外,我们还展示了一项探索VoiceX能力的用户研究结果。我们证明VoiceX是创建个性化自定义声音的合适工具。

英文摘要:

Modern TTS systems are capable of creating highly realistic and natural-sounding speech. Despite these developments, the process of customizing TTS voices remains a complex task, mostly requiring the expertise of specialists within the field. One reason for this is the utilization of deep learning models, which are characterized by their expansive, non-interpretable parameter spaces, restricting the feasibility of manual customization. In this paper, we present a novel human-in-the-loop paradigm based on an evolutionary algorithm for directly interacting with the parameter space of a neural TTS model. We integrated our approach into a user-friendly graphical user interface that allows users to efficiently create original voices. Those voices can then be used with the backbone TTS model, for which we provide a Python API. Further, we present the results of a user study exploring the capabilities of VoiceX. We show that VoiceX is an appropriate tool for creating individual, custom voices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑