arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.05657cs.SDcs.LGeess.AS
收藏

基于短时上下文信息的端到端汉语声调分类

End-to-End Mandarin Tone Classification with Short Term Context Information

Data Science Research Center, Duke Kunshan University(昆山杜克大学数据科学研究中心)

Jiyang Tang, Ming Li

摘要:

在本文中,我们提出了一个端到端的普通话声调分类方法,从连续的语音话语利用频谱图和短期的上下文信息作为输入。声谱图和上下文段特征都被用来训练声调分类器。我们首先使用由ASR模型产生的力对齐结果将声谱图帧划分为音节段。然后,我们提取短期段特征,以捕获跨多个音节的上下文信息。将声谱图和短期上下文段特征馈送到端到端模型中可以显着提高性能。在一个大规模的开源汉语语音数据集上进行实验,以评估所提出的方法。在AISHELL3数据库上的实验结果表明,该方法将分类准确率从79.5%提高到92.6%。

英文摘要:

In this paper, we propose an end-to-end Mandarin tone classification method from continuous speech utterances utilizing both the spectrogram and the short-term context information as the input. Both spectrograms and context segment features are used to train the tone classifier. We first divide the spectrogram frames into syllable segments using force alignment results produced by an ASR model. Then we extract the short-term segment features to capture the context information across multiple syllables. Feeding both the spectrogram and the short-term context segment features into an end-to-end model could significantly improve the performance. Experiments are performed on a large-scale open-source Mandarin speech dataset to evaluate the proposed method. Results show that this method improves the classification accuracy from 79.5% to 92.6% on the AISHELL3 database.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑