arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.08352cs.SDcs.LGeess.AS
收藏

MOSNet:基于深度学习的语音转换客观评估

MOSNet: Deep Learning based Objective Assessment for Voice Conversion

Institute of Information Science, Academia Sinica(中央研究院资讯科学研究所);Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心);National Institute of Informatics(国立情报学研究所)

Chen-Chou Lo, Szu-Wei Fu, Wen-Chin Huang, Xin Wang, Junichi Yamagishi, Yu Tsao, Hsin-Min Wang

摘要:

现有的语音转换(VC)的客观评价指标并不总是与人类的感知。因此,用这样的标准训练VC模型可能不能有效地提高转换语音的自然度和相似度。在本文中,我们提出了基于深度学习的评估模型来预测人类对转换语音的评级。我们采用卷积和递归神经网络模型来构建平均意见得分(MOS)预测器,称为MOSNet。所提出的模型在2018年语音转换挑战赛(VCC)的大规模听力测试结果上进行了测试。实验结果表明,所提出的MOSNet的预测分数是高度相关的人类MOS评级在系统级,而相当相关的人类MOS评级在话语级。同时,我们修改了MOSNet来预测相似性分数,初步的结果表明,预测的分数也与人类的评级相当相关。这些结果证实,所提出的模型可以用作计算评估器来测量VC系统的MOS,以减少昂贵的人力评级的需要。

英文摘要:

Existing objective evaluation metrics for voice conversion (VC) are not always correlated with human perception. Therefore, training VC models with such criteria may not effectively improve naturalness and similarity of converted speech. In this paper, we propose deep learning-based assessment models to predict human ratings of converted speech. We adopt the convolutional and recurrent neural network models to build a mean opinion score (MOS) predictor, termed as MOSNet. The proposed models are tested on large-scale listening test results of the Voice Conversion Challenge (VCC) 2018. Experimental results show that the predicted scores of the proposed MOSNet are highly correlated with human MOS ratings at the system level while being fairly correlated with human MOS ratings at the utterance level. Meanwhile, we have modified MOSNet to predict the similarity scores, and the preliminary results show that the predicted scores are also fairly correlated with human ratings. These results confirm that the proposed models could be used as a computational evaluator to measure the MOS of VC systems to reduce the need for expensive human rating.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑