arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1606.05925stat.MLcs.CLcs.LG
收藏

基于图的流形正则化深度神经网络语音识别

Graph based manifold regularized deep neural networks for automatic speech recognition

McGill University(麦吉尔大学);Google Inc.(谷歌公司)

Vikrant Singh Tomar, Richard C. Rose

摘要:

近年来,深度神经网络(DNN)已成功应用于各种声学建模任务。这些包括DNN在判别特征提取或混合声学建模场景中的应用。尽管在这一领域取得了快速进展,但在训练DNN方面仍然存在许多挑战。本文提出了一种使用基于流形学习的正则化框架来训练DNN的有效方法。在这个框架中,网络的参数进行了优化,以保持语音特征向量之间基于流形的关系,同时最大限度地减少网络输出和目标之间的损失。这是通过将基于流形的局部约束纳入DNN的客观标准来实现的。经验证据表明,训练一个网络与流形约束保持在网络的隐藏层的结构紧凑性。在基于隐马尔可夫模型(HMM)的语音识别中,流形正则化被应用于训练瓶颈DNN的特征提取。实验在Aurora-2语音数字和Aurora-4读新闻大词汇量连续语音识别任务上进行。性能通过这些任务的字错误率(WER)来衡量。结果表明,流形正则化DNN导致WER相对于标准DNN减少高达37%。

英文摘要:

Deep neural networks (DNNs) have been successfully applied to a wide variety of acoustic modeling tasks in recent years. These include the applications of DNNs either in a discriminative feature extraction or in a hybrid acoustic modeling scenario. Despite the rapid progress in this area, a number of challenges remain in training DNNs. This paper presents an effective way of training DNNs using a manifold learning based regularization framework. In this framework, the parameters of the network are optimized to preserve underlying manifold based relationships between speech feature vectors while minimizing a measure of loss between network outputs and targets. This is achieved by incorporating manifold based locality constraints in the objective criterion of DNNs. Empirical evidence is provided to demonstrate that training a network with manifold constraints preserves structural compactness in the hidden layers of the network. Manifold regularization is applied to train bottleneck DNNs for feature extraction in hidden Markov model (HMM) based speech recognition. The experiments in this work are conducted on the Aurora-2 spoken digits and the Aurora-4 read news large vocabulary continuous speech recognition tasks. The performance is measured in terms of word error rate (WER) on these tasks. It is shown that the manifold regularized DNNs result in up to 37% reduction in WER relative to standard DNNs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑