基于模型合并的语音合成属性插值方法
An Attribute Interpolation Method in Speech Synthesis by Model Merging
AI总结:
本文提出一种仅通过平均基础模型参数实现语音合成属性插值的方法,无需额外模块或训练,在说话人生成和情感强度控制任务中验证了其平滑插值且保持语言内容的效果。
摘要:
随着语音合成的发展,近年来的研究聚焦于具有挑战性的任务,例如说话人生成和情感强度控制。属性插值是处理这些任务的常用方法。然而,以往大多数属性插值方法需要特定的模块或训练方法。我们提出了一种通过模型合并实现语音合成属性插值的方法。模型合并是一种仅通过对基础模型参数取平均来创建新参数的方法。合并后的模型能够生成具有基础模型中间特征的输出。由于该方法仅使用现有的已训练基础模型,因此无需特定模块或训练方法即可轻松应用。我们合并了两个文本到语音模型以实现属性插值,并在说话人生成和情感强度控制任务上评估了其性能。结果表明,我们提出的方法在这两项任务中均实现了平滑的属性插值,同时保持了语言内容。
英文摘要:
With the development of speech synthesis, recent research has focused on challenging tasks, such as speaker generation and emotion intensity control. Attribute interpolation is a common approach to these tasks. However, most previous methods for attribute interpolation require specific modules or training methods. We propose an attribute interpolation method in speech synthesis by model merging. Model merging is a method that creates new parameters by only averaging the parameters of base models. The merged model can generate an output with an intermediate feature of the base models. This method is easily applicable without specific modules or training methods, as it uses only existing trained base models. We merged two text-to-speech models to achieve attribute interpolation and evaluated its performance on speaker generation and emotion intensity control tasks. As a result, our proposed method achieved smooth attribute interpolation while keeping the linguistic content in both tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。