arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.11420cs.SDeess.AS
收藏

语音转换领域的深层神经结构及其可解释性研究

Investigating Deep Neural Structures and their Interpretability in the Domain of Voice Conversion

University of Sheffield(谢菲尔德大学)

Samuel J. Broughton, Md Asif Jalal, Roger K. Moore

摘要:

生成对抗网络(GANs)是基于创建合成数据的机器学习网络。语音转换(VC)是语音翻译的一个子集,它涉及将源说话人的语言特征翻译成目标说话人,同时保留语言信息。VC的非并行条件GANs的目的是将声学语音特征序列从一个域转换到另一个域,而不使用配对数据。在这里报告的研究中,我们研究了VC领域中非并行GANs的最新实现的可解释性。我们发现,在一个特定的GAN架构的重复层的学习表示保持接近其原始的随机初始化参数,这表明它是重复层的数量,更负责的输出质量。我们还分析了在另一个数据集上进行迁移学习时,在一个特定数据集上训练的模型的学习表示。这表明整个网络的相似性非常高。总之,这些结果为深度生成网络的学习表示在学习过程中如何变化以及层数的重要性提供了新的见解。

英文摘要:

Generative Adversarial Networks (GANs) are machine learning networks based around creating synthetic data. Voice Conversion (VC) is a subset of voice translation that involves translating the paralinguistic features of a source speaker to a target speaker while preserving the linguistic information. The aim of non-parallel conditional GANs for VC is to translate an acoustic speech feature sequence from one domain to another without the use of paired data. In the study reported here, we investigated the interpretability of state-of-the-art implementations of non-parallel GANs in the domain of VC. We show that the learned representations in the repeating layers of a particular GAN architecture remain close to their original random initialised parameters, demonstrating that it is the number of repeating layers that is more responsible for the quality of the output. We also analysed the learned representations of a model trained on one particular dataset when used during transfer learning on another dataset. This showed extremely high levels of similarity across the entire network. Together, these results provide new insight into how the learned representations of deep generative networks change during learning and the importance in the number of layers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑