arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1902.07374eess.AScs.LGcs.SD
收藏

使用基于注意力的CNN-BLSTM的话语级端到端语言识别

Utterance-level end-to-end language identification using attention-based CNN-BLSTM

Duke Kunshan University(昆山杜克大学);Sun Yat-sen University(中山大学);Tencent Research(腾讯研究院)

Weicheng Cai, Danwei Cai, Shen Huang, Ming Li

摘要:

在本文中,我们提出了一个端到端的语言识别框架,基于注意力的卷积神经网络-双向长短期记忆(CNN-BLSTM)。该模型是在话语级上执行的,这意味着话语级决策可以直接从神经网络的输出中获得。为了处理具有整个任意和潜在长持续时间的语音话语,我们将CNN-BLSTM模型与自注意池层结合在一起。前端CNN-BLSTM模块充当可变长度输入的局部模式提取器,并且在其上构建以下自关注池化层以获得固定维度的话语级表示。我们在NIST LRE 07闭集任务上进行了实验,结果表明,所提出的基于注意力的CNN-BLSTM模型在所有3秒,10秒,30秒持续时间的任务上都实现了与其他最先进的话语级神经网络方法相当的错误减少。

英文摘要:

In this paper, we present an end-to-end language identification framework, the attention-based Convolutional Neural Network-Bidirectional Long-short Term Memory (CNN-BLSTM). The model is performed on the utterance level, which means the utterance-level decision can be directly obtained from the output of the neural network. To handle speech utterances with entire arbitrary and potentially long duration, we combine CNN-BLSTM model with a self-attentive pooling layer together. The front-end CNN-BLSTM module plays a role as local pattern extractor for the variable-length inputs, and the following self-attentive pooling layer is built on top to get the fixed-dimensional utterance-level representation. We conducted experiments on NIST LRE07 closed-set task, and the results reveal that the proposed attention-based CNN-BLSTM model achieves comparable error reduction with other state-of-the-art utterance-level neural network approaches for all 3 seconds, 10 seconds, 30 seconds duration tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑