UTMOS:VoiceMOS 2022挑战赛的UTokyo-SaruLab系统
UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022
摘要:
我们介绍了提交给2022年VoiceMOS挑战赛的UTokyo-SaruLab平均意见评分(MOS)预测系统。挑战是预测从以前的暴雪挑战和语音转换挑战中收集的两个音轨的语音样本的MOS值:一个用于域内预测的主音轨和一个来自不同听力测试的标记数据较少的域外(OOD)音轨。我们的系统是基于集成学习的强和弱的学习者。强学习者对以前的自监督学习(SSL)模型的微调模型进行了一些改进,而弱学习者使用基本的机器学习方法来预测SSL特征的分数。在挑战赛中,我们的系统在主要和OOD轨道的几个指标上得分最高。此外,我们进行了消融研究,以调查我们提出的方法的有效性。
英文摘要:
We present the UTokyo-SaruLab mean opinion score (MOS) prediction system submitted to VoiceMOS Challenge 2022. The challenge is to predict the MOS values of speech samples collected from previous Blizzard Challenges and Voice Conversion Challenges for two tracks: a main track for in-domain prediction and an out-of-domain (OOD) track for which there is less labeled data from different listening tests. Our system is based on ensemble learning of strong and weak learners. Strong learners incorporate several improvements to the previous fine-tuning models of self-supervised learning (SSL) models, while weak learners use basic machine-learning methods to predict scores from SSL features. In the Challenge, our system had the highest score on several metrics for both the main and OOD tracks. In addition, we conducted ablation studies to investigate the effectiveness of our proposed methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。