arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1812.00686cs.CL
收藏

建立端到端响应选择的序贯推理模型

Building Sequential Inference Models for End-to-End Response Selection

National Engineering Laboratory for Speech and Language Information ProcessingUniversity of Science and Technology of China(中国科学技术大学语音及语言信息处理国家工程实验室);iFLYTEK Research(科大讯飞研究)

Jia-Chen Gu, Zhen-Hua Ling, Yu-Ping Ruan, Quan Liu

摘要:

本文提出了一个端到端的响应选择模型的第七届对话系统技术挑战赛(DSTC 7)的轨道1。这个任务的重点是从一组给定部分对话的候选者中选择正确的下一个话语。我们提出了一个端到端的神经网络的基础上,增强顺序推理模型(ESIM)的这项任务。我们提出的模型不同于原来的ESIM模型在以下四个方面。首先,采用一种新的词表示方法,该方法将一般的预训练词嵌入与在特定任务训练集上估计的词嵌入相结合,以解决词汇表外(OOV)词的挑战。其次,设计了一个注意分层递归编码器(AHRE),它能够分层编码句子,并通过聚合产生更多的描述性表示。第三,采用多维池化和最终状态池化相结合的新池化方法代替了原ESIM中最大池化和平均池化的简单组合。最后,在softmax层之前添加修改层,以强调上下文中最后一个话语的重要性,以进行响应选择。在DSTC 7发布的评估结果中,我们提出的方法在Ubuntu数据集上排名第二,在Track 1的子任务1中的Advising数据集中排名第三。

英文摘要:

This paper presents an end-to-end response selection model for Track 1 of the 7th Dialogue System Technology Challenges (DSTC7). This task focuses on selecting the correct next utterance from a set of candidates given a partial conversation. We propose an end-to-end neural network based on enhanced sequential inference model (ESIM) for this task. Our proposed model differs from the original ESIM model in the following four aspects. First, a new word representation method which combines the general pre-trained word embeddings with those estimated on the task-specific training set is adopted in order to address the challenge of out-of-vocabulary (OOV) words. Second, an attentive hierarchical recurrent encoder (AHRE) is designed which is capable to encode sentences hierarchically and generate more descriptive representations by aggregation. Third, a new pooling method which combines multi-dimensional pooling and last-state pooling is used instead of the simple combination of max pooling and average pooling in the original ESIM. Last, a modification layer is added before the softmax layer to emphasize the importance of the last utterance in the context for response selection. In the released evaluation results of DSTC7, our proposed method ranked second on the Ubuntu dataset and third on the Advising dataset in subtask 1 of Track 1.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑