Varianceflow:通过归一化流使用方差信息的高质量和可控的文本转语音
Varianceflow: High-Quality and Controllable Text-to-Speech using Variance Information via Normalizing Flow
摘要:
非自回归文本转语音模型有两种方法可以有效地学习文本和语音之间的一对多关系。第一种是使用高级生成框架,如规范化流(NF)。第二种方法是在生成语音时将音调或能量等方差信息结合起来使用。对于第二种类型,还可以通过调整提供给模型的方差值来控制方差因子。在本文中,我们提出了一种新的模型称为VarianceFlow结合这两种类型的优点。方差流通过NF对方差进行建模,可以更准确地预测方差信息,提高语音质量。此外,NF的目标函数使得模型以一种分离的方式使用方差信息和文本,从而实现更精确的方差控制。在实验中,VarianceFlow表现出优越的性能比其他国家的最先进的TTS模型无论是在语音质量和可控性。
英文摘要:
There are two types of methods for non-autoregressive text-to-speech models to learn the one-to-many relationship between text and speech effectively. The first one is to use an advanced generative framework such as normalizing flow (NF). The second one is to use variance information such as pitch or energy together when generating speech. For the second type, it is also possible to control the variance factors by adjusting the variance values provided to a model. In this paper, we propose a novel model called VarianceFlow combining the advantages of the two types. By modeling the variance with NF, VarianceFlow predicts the variance information more precisely with improved speech quality. Also, the objective function of NF makes the model use the variance information and the text in a disentangled manner resulting in more precise variance control. In experiments, VarianceFlow shows superior performance over other state-of-the-art TTS models both in terms of speech quality and controllability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。