arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1608.07775cs.CL
收藏

基于层次注意模型的口语内容机器理解

Hierarchical Attention Model for Improved Machine Comprehension of Spoken Content

National Taiwan University(国立台湾大学)

Wei Fang, Jui-Yang Hsu, Hung-yi Lee, Lin-Shan Lee

摘要:

多媒体或语音内容比纯文本内容呈现更有吸引力的信息,但是前者更难以在屏幕上显示并被用户选择。因此,对于人类来说,访问前者的大量集合比后者更困难和耗时。因此,开发能够自动理解语音内容并总结关键信息供人类浏览的机器是非常有吸引力的。在这一努力中,最近提出了一个新的任务,机器理解的口语内容。最初的目标被定义为托福的听力理解测试,这是一项针对母语不是英语的英语学习者的具有挑战性的学术英语考试。提出了一种基于注意力的多跳递归神经网络(AMRNN)结构,该结构只考虑语音话语中的顺序关系。在本文中,我们提出了一个新的层次注意力模型(HAM),它构建了一个多跳的注意力机制的树结构,而不是顺序表示的话语。提高理解性能稳健的ASR错误。

英文摘要:

Multimedia or spoken content presents more attractive information than plain text content, but the former is more difficult to display on a screen and be selected by a user. As a result, accessing large collections of the former is much more difficult and time-consuming than the latter for humans. It's therefore highly attractive to develop machines which can automatically understand spoken content and summarize the key information for humans to browse over. In this endeavor, a new task of machine comprehension of spoken content was proposed recently. The initial goal was defined as the listening comprehension test of TOEFL, a challenging academic English examination for English learners whose native languages are not English. An Attention-based Multi-hop Recurrent Neural Network (AMRNN) architecture was also proposed for this task, which considered only the sequential relationship within the speech utterances. In this paper, we propose a new Hierarchical Attention Model (HAM), which constructs multi-hopped attention mechanism over tree-structured rather than sequential representations for the utterances. Improved comprehension performance robust with respect to ASR errors were obtained.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑