arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.02899eess.AScs.SD

End-to-end acoustic modelling for phone recognition of young readers

Paul Sabatier University(保罗萨巴蒂尔大学);CNRS(法国国家科学研究中心);Lalilo(拉利洛公司)

Lucile Gelin, Morgane Daniel, Julien Pinquier, Thomas Pellegrini

英文摘要:

Automatic recognition systems for child speech are lagging behind those dedicated to adult speech in the race of performance. This phenomenon is due to the high acoustic and linguistic variability present in child speech caused by their body development, as well as the lack of available child speech data. Young readers speech additionally displays peculiarities, such as slow reading rate and presence of reading mistakes, that hardens the task. This work attempts to tackle the main challenges in phone acoustic modelling for young child speech with limited data, and improve understanding of strengths and weaknesses of a wide selection of model architectures in this domain. We find that transfer learning techniques are highly efficient on end-to-end architectures for adult-to-child adaptation with a small amount of child speech data. Through transfer learning, a Transformer model complemented with a Connectionist Temporal Classification (CTC) objective function, reaches a phone error rate of 28.1%, outperforming a state-of-the-art DNN-HMM model by 6.6% relative, as well as other end-to-end architectures by more than 8.5% relative. An analysis of the models' performance on two specific reading tasks (isolated words and sentences) is provided, showing the influence of the utterance length on attention-based and CTC-based models. The Transformer+CTC model displays an ability to better detect reading mistakes made by children, that can be attributed to the CTC objective function effectively constraining the attention mechanisms to be monotonic.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑