arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2105.06337cs.LGcs.CLstat.ML
收藏

Grad-TTS:一种用于文语转换的扩散概率模型

Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech

Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Higher School of Economics(高等经济学院)

Vadim Popov, Ivan Vovk, Vladimir Gogoryan, Tasnima Sadekova, Mikhail Kudinov

摘要:

最近,去噪扩散概率模型和生成分数匹配在模拟复杂的数据分布方面显示出很高的潜力,而随机微积分为这些技术提供了一个统一的观点,允许灵活的推理方案。在本文中,我们介绍了梯度TTS,一种新的文本到语音的模型与分数为基础的解码器产生梅尔频谱逐渐变换噪声预测编码器和对齐的文本输入通过单调对齐搜索。随机微分方程的框架,帮助我们推广传统的扩散概率模型的情况下,重建数据的噪声与不同的参数,并允许通过显式控制声音质量和推理速度之间的权衡,使这种重建灵活。主观的人类评价表明,梯度TTS是最先进的文本到语音的方法在平均意见得分方面的竞争力。我们将很快公开代码。

英文摘要:

Recently, denoising diffusion probabilistic models and generative score matching have shown high potential in modelling complex data distributions while stochastic calculus has provided a unified point of view on these techniques allowing for flexible inference schemes. In this paper we introduce Grad-TTS, a novel text-to-speech model with score-based decoder producing mel-spectrograms by gradually transforming noise predicted by encoder and aligned with text input by means of Monotonic Alignment Search. The framework of stochastic differential equations helps us to generalize conventional diffusion probabilistic models to the case of reconstructing data from noise with different parameters and allows to make this reconstruction flexible by explicitly controlling trade-off between sound quality and inference speed. Subjective human evaluation shows that Grad-TTS is competitive with state-of-the-art text-to-speech approaches in terms of Mean Opinion Score. We will make the code publicly available shortly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑