基于深度学习的辅音-元音过渡模型及其发音清晰度客观评价
Consonant-Vowel Transition Models Based on Deep Learning for Objective Evaluation of Articulation
摘要:
辅音-元音(CV)过渡区的频谱-时间动态被认为是提供与发音相关的鲁棒线索。在这项工作中,我们提出了一个客观的措施,精确的清晰度,被称为客观清晰度措施(OAM),通过分析CV过渡分割周围元音起始。OAM是基于卷积神经网络的后验子导出的,该卷积神经网络被预先训练成使用CV区域作为输入在不同辅音之间进行分类。我们证明OAM与各种背景下的感知测量相关,包括(a)成人构音障碍言语,(b)唇/腭裂儿童的言语,以及(c)来自母语普通话和西班牙语的口音英语言语数据库。
英文摘要:
Spectro-temporal dynamics of consonant-vowel (CV) transition regions are considered to provide robust cues related to articulation. In this work, we propose an objective measure of precise articulation, dubbed the objective articulation measure (OAM), by analyzing the CV transitions segmented around vowel onsets. The OAM is derived based on the posteriors of a convolutional neural network pre-trained to classify between different consonants using CV regions as input. We demonstrate the OAM is correlated with perceptual measures in a variety of contexts including (a) adult dysarthric speech, (b) the speech of children with cleft lip/palate, and (c) a database of accented English speech from native Mandarin and Spanish speakers.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。