Building Sequential Inference Models for End-to-End Response Selection
National Engineering Laboratory for Speech and Language Information ProcessingUniversity of Science and Technology of China(中国科学技术大学语音及语言信息处理国家工程实验室);iFLYTEK Research(科大讯飞研究)
Jia-Chen Gu, Zhen-Hua Ling, Yu-Ping Ruan, Quan Liu
This paper presents an end-to-end response selection model for Track 1 of the 7th Dialogue System Technology Challenges (DSTC7). This task focuses on selecting the correct next utterance from a set of candidates given a partial conversation. We propose an end-to-end neural network based on enhanced sequential inference model (ESIM) for this task. Our proposed model differs from the original ESIM model in the following four aspects. First, a new word representation method which combines the general pre-trained word embeddings with those estimated on the task-specific training set is adopted in order to address the challenge of out-of-vocabulary (OOV) words. Second, an attentive hierarchical recurrent encoder (AHRE) is designed which is capable to encode sentences hierarchically and generate more descriptive representations by aggregation. Third, a new pooling method which combines multi-dimensional pooling and last-state pooling is used instead of the simple combination of max pooling and average pooling in the original ESIM. Last, a modification layer is added before the softmax layer to emphasize the importance of the last utterance in the context for response selection. In the released evaluation results of DSTC7, our proposed method ranked second on the Ubuntu dataset and third on the Advising dataset in subtask 1 of Track 1.
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
State Key Lab of Software Development Environment, Beihang University(北京航空航天大学软件开发环境国家重点实验室);Microsoft Research(微软研究院);College of Computer and Control Engineering, Nankai University(南开大学计算机与控制工程学院)
From Myopic Selection to Long-Horizon Awareness: Sequential LLM Routing for Multi-Turn Dialogue
School of Computer Science, Shanghai Jiao Tong University, Shanghai, China(上海交通大学计算机科学学院);WeChat, Tencent Inc, Beijing, China(腾讯北京研发中心);University at Buffalo, New York, United States(布法罗大学)