arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.02126cs.CL
收藏

基于顺序神经网络的端到端响应选择

Sequential Neural Networks for Noetic End-to-End Response Selection

DAMO Academy, Alibaba Group(达摩院,阿里巴巴集团)

Qian Chen, Wen Wang

摘要:

作为第七届对话系统技术挑战赛(DSTC 7)中的一个轨道,思维端到端响应选择挑战赛旨在推动现实世界目标导向对话系统的话语分类技术的发展,参与者需要从多轮上下文的一组候选者中选择正确的下一个话语。本文介绍了我们的系统,在这一挑战下,在两个数据集上都排名第一,一个是集中的小(Advising),另一个是更多样化的大(Ubuntu)。先前的最先进的模型使用基于层次(话语级和令牌级)的神经网络来显式地对不同话轮的话语之间的交互进行建模,以用于上下文建模。在本文中,我们研究了一个顺序匹配模型的基础上,只有链序列的多轮响应选择。我们的研究结果表明,顺序匹配方法的潜力还没有得到充分利用,在过去的多轮响应选择。除了在挑战中排名前1外,该模型在两个大规模公共多轮响应选择基准数据集上的表现优于所有以前的模型,包括最先进的基于层次的模型。

英文摘要:

The noetic end-to-end response selection challenge as one track in the 7th Dialog System Technology Challenges (DSTC7) aims to push the state of the art of utterance classification for real world goal-oriented dialog systems, for which participants need to select the correct next utterances from a set of candidates for the multi-turn context. This paper presents our systems that are ranked top 1 on both datasets under this challenge, one focused and small (Advising) and the other more diverse and large (Ubuntu). Previous state-of-the-art models use hierarchy-based (utterance-level and token-level) neural networks to explicitly model the interactions among different turns' utterances for context modeling. In this paper, we investigate a sequential matching model based only on chain sequence for multi-turn response selection. Our results demonstrate that the potentials of sequential matching approaches have not yet been fully exploited in the past for multi-turn response selection. In addition to ranking top 1 in the challenge, the proposed model outperforms all previous models, including state-of-the-art hierarchy-based models, on two large-scale public multi-turn response selection benchmark datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑