arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.20374cs.CLcs.SDeess.AS
收藏

面向跨语言 TTS 系统的逐词语调模型

Word-wise intonation model for cross-language TTS systems

STC, Ltd(STC有限公司);ITMO University(ITMO大学)

Tomilov A. A., Gromova A. Y., Svischev A. N

AI总结:

本文提出一种可跨语言推广的逐词语调模型,通过音高简化与动态时间规整聚类消除重音位置变异性,可用于 TTS 韵律建模与语调研究。

摘要:

本文提出了一种面向俄语的逐词语调模型,并展示其如何推广到其他语言。该模型适用于自动数据标注,并可扩展应用于文本到语音系统。它还可以通过基于规则的算法或利用语言模型预测语调轮廓来实现语调轮廓建模。其核心思想是部分消除与单词中重读音节位置不同相关的变异性。这一目标通过同时应用音高简化和动态时间规整聚类来实现。所提出的模型既可用作语调研究的工具,也可作为文本到语音系统中韵律描述的骨干。作为该模型的优势,我们展示了其与现有语调系统的关系,以及使用语言模型进行韵律预测的可能性。最后,我们给出了一些系统对参数变化具有鲁棒性的实际证据。

英文摘要:

In this paper we propose a word-wise intonation model for Russian language and show how it can be generalized for other languages. The proposed model is suitable for automatic data markup and its extended application to text-to-speech systems. It can also be implemented for an intonation contour modeling by using rule-based algorithms or by predicting contours with language models. The key idea is a partial elimination of the variability connected with different placements of a stressed syllable in a word. It is achieved with simultaneous applying of pitch simplification with a dynamic time warping clustering. The proposed model could be used as a tool for intonation research or as a backbone for prosody description in text-to-speech systems. As the advantage of the model, we show its relations with the existing intonation systems as well as the possibility of using language models for prosody prediction. Finally, we demonstrate some practical evidence of the system robustness to parameter variations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑