Embedding-based approaches for dialog response retrieval embed the context-response pairs as points in the embedding space. These approaches are scalable, but fail to account for the complex, many-to-many relationships that exist between context-response pairs. On the other end of the spectrum, there are approaches that feed the context-response pairs jointly through multiple layers of neural networks. These approaches can model the complex relationships between context-response pairs, but fail to scale when the set of responses is moderately large (>100). In this paper, we combine the best of both worlds by proposing a scalable model that can learn complex relationships between context-response pairs. Specifically, the model maps the contexts as well as responses to probability distributions over the embedding space. We train the models by optimizing the Kullback-Leibler divergence between the distributions induced by context-response pairs in the training data. We show that the resultant model achieves better performance as compared to other embedding-based approaches on publicly available conversation data.
Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Microsoft Corporation(微软公司);Center for Data Science, Peking University(北京大学数据科学研究中心)
Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots
Wangxuan Institute of Computer Technology(王选计算机技术研究所);Center for Data Science(数据科学中心);Academy for Advanced Interdisciplinary Studies(前沿交叉学科研究院);Peking University(北京大学);Soochow University(苏州大学);Gaoling School of Artificial Intelligence(高瓴人工智能学院);Renmin University of China(中国人民大学)
Dialogizer: Context-aware Conversational-QA Dataset Generation from Textual Sources
LG AI Research(LG AI研究院);IPAI, Seoul National University(首尔大学IPAI);Dept. of ECE, Seoul National University(首尔大学电子与计算机工程系);Chung-Ang University(中央大学);SNU-LG AI Research Center(首尔大学-LG AI研究中心)
Hi Model, generating 'nice' instead of 'good' is not as bad as generating 'rice'! Towards Context and Semantic Infused Dialogue Generation Loss Function and Evaluation Metric
Indian Institute of Technology Patna(印度理工学院巴特那分校);University of South Carolina(南卡罗来纳大学);Indian Institute of Technology Bombay(印度理工学院孟买分校)
Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems
Computer Center, Peking University(北京大学计算机中心);Department of Computer Science and Technology, Peking University(北京大学计算机科学与技术系);Wangxuan Institute of Computer Technology, Peking University(北京大学王轩计算机技术研究所)
The World is Not Binary: Learning to Rank with Grayscale Data for Dialogue Response Selection
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);The Chinese University of Hong Kong(香港中文大学);Tencent AI Lab(腾讯人工智能实验室)