arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1901.02609cs.CL
收藏

基于顺序注意网络的感知端到端响应选择

Sequential Attention-based Network for Noetic End-to-End Response Selection

DAMO Academy, Alibaba Group(阿里巴巴集团达摩院)

Qian Chen, Wen Wang

摘要:

作为对话系统技术挑战7(DSTC 7)中的一个轨道的思维端到端响应选择挑战旨在推动现实世界目标导向对话系统的话语分类的最新技术水平,对于该对话系统,参与者需要从多轮上下文的一组候选者中选择正确的下一个话语。本文描述了我们的系统,在这一挑战下,我们的系统在两个数据集上都排名第一,一个是集中的小数据集(Advising),另一个是更多样化的大数据集(Ubuntu)。先前的最先进的模型使用基于层次(话语级和令牌级)的神经网络来显式地对不同话轮的话语之间的交互进行建模,以用于上下文建模。在本文中,我们研究了一个顺序匹配模型的基础上,只有链序列的多轮响应选择。我们的研究结果表明,顺序匹配方法的潜力还没有得到充分利用,在过去的多轮响应选择。除了在挑战中排名第一之外,所提出的模型优于所有以前的模型,包括最先进的基于层次的模型,并在两个大规模公共多回合响应选择基准数据集上实现了新的最先进的性能。

英文摘要:

The noetic end-to-end response selection challenge as one track in Dialog System Technology Challenges 7 (DSTC7) aims to push the state of the art of utterance classification for real world goal-oriented dialog systems, for which participants need to select the correct next utterances from a set of candidates for the multi-turn context. This paper describes our systems that are ranked the top on both datasets under this challenge, one focused and small (Advising) and the other more diverse and large (Ubuntu). Previous state-of-the-art models use hierarchy-based (utterance-level and token-level) neural networks to explicitly model the interactions among different turns' utterances for context modeling. In this paper, we investigate a sequential matching model based only on chain sequence for multi-turn response selection. Our results demonstrate that the potentials of sequential matching approaches have not yet been fully exploited in the past for multi-turn response selection. In addition to ranking the top in the challenge, the proposed model outperforms all previous models, including state-of-the-art hierarchy-based models, and achieves new state-of-the-art performances on two large-scale public multi-turn response selection benchmark datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑