arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.08987cs.CLcs.AI
收藏

一种新的复杂Twitter数据集上的健壮语义框架解析流水线

A Robust Semantic Frame Parsing Pipeline on a New Complex Twitter Dataset

Yu Wang, Hongxia Jin

摘要:

最近的口语语言理解(SLU)语义框架分析系统是基于递归神经网络设计的。这些系统在基准SLU数据集(如ATIS或SNIPS)上显示出不错的性能,这些数据集包含具有相对简单模式的短话语。然而,目前的语义框架解析模型缺乏一种机制来处理分布外(\emph{OOD})模式和词汇外(\emph{OOV})令牌。在本文中,我们介绍了一个强大的语义框架解析管道,可以处理两个\emph{OOD}模式和\emph{OOV}令牌结合一个新的复杂的Twitter数据集,包含长推文更多的\emph{OOD}模式和\emph{OOV}令牌。与SNIPS数据集和新的Twitter数据集(我们的新Twitter数据集可以从https://1drv.ms/u/s下载!AroHb-W6_OAlavK4begsDsMALfE?e=c8f2XX)。最后,我们还建立了一个E2 E应用程序来演示我们的算法的可行性,并显示为什么它是有用的,在实际应用中。

英文摘要:

Most recent semantic frame parsing systems for spoken language understanding (SLU) are designed based on recurrent neural networks. These systems display decent performance on benchmark SLU datasets such as ATIS or SNIPS, which contain short utterances with relatively simple patterns. However, the current semantic frame parsing models lack a mechanism to handle out-of-distribution (\emph{OOD}) patterns and out-of-vocabulary (\emph{OOV}) tokens. In this paper, we introduce a robust semantic frame parsing pipeline that can handle both \emph{OOD} patterns and \emph{OOV} tokens in conjunction with a new complex Twitter dataset that contains long tweets with more \emph{OOD} patterns and \emph{OOV} tokens. The new pipeline demonstrates much better results in comparison to state-of-the-art baseline SLU models on both the SNIPS dataset and the new Twitter dataset (Our new Twitter dataset can be downloaded from https://1drv.ms/u/s!AroHb-W6_OAlavK4begsDsMALfE?e=c8f2XX ). Finally, we also build an E2E application to demo the feasibility of our algorithm and show why it is useful in real application.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑