arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.00482cs.CL
收藏

IRRGN:一种用于多轮响应选择的隐式关系推理图网络

IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection

College of Computer and Information Science, Southwest University(西南大学计算机与信息科学学院);yz-intelligence Inc(元智智能公司);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)

Jingcheng Deng, Hengwei Dai, Xuewei Guo, Yuanchen Ju, Wei Peng

AI总结:

针对多轮对话响应选择中显式算法建模依赖关系局限且忽略选项差异的问题,提出隐式关系推理图网络(IRRGN),通过话语关系推理器和选项双重比较器联合优化,在MuTual等基准上取得SOTA并首次超越人类表现。

摘要:

多轮对话中响应选择任务的目标是从所有候选选项中找出最佳选项。为了提升模型的推理能力,以往研究更多关注使用显式算法来建模话语之间的依赖关系,这些方法具有确定性、局限性且缺乏灵活性。此外,很少有研究考虑推理前后选项之间的差异。在本文中,我们提出了一种隐式关系推理图网络(IRRGN)来解决这些问题,该网络由话语关系推理器(URR)和选项双重比较器(ODC)组成。URR旨在隐式地提取话语之间以及话语与选项之间的依赖关系,并利用关系图卷积网络进行推理。ODC侧重于通过双重比较来感知选项之间的差异,从而消除噪声选项的干扰。在两个多轮对话推理基准数据集MuTual和MuTual+上的实验结果表明,我们的方法显著提升了四个预训练语言模型的基线,并取得了最先进的性能。该模型首次在MuTual数据集上超越了人类表现。

英文摘要:

The task of response selection in multi-turn dialogue is to find the best option from all candidates. In order to improve the reasoning ability of the model, previous studies pay more attention to using explicit algorithms to model the dependencies between utterances, which are deterministic, limited and inflexible. In addition, few studies consider differences between the options before and after reasoning. In this paper, we propose an Implicit Relational Reasoning Graph Network to address these issues, which consists of the Utterance Relational Reasoner (URR) and the Option Dual Comparator (ODC). URR aims to implicitly extract dependencies between utterances, as well as utterances and options, and make reasoning with relational graph convolutional networks. ODC focuses on perceiving the difference between the options through dual comparison, which can eliminate the interference of the noise options. Experimental results on two multi-turn dialogue reasoning benchmark datasets MuTual and MuTual+ show that our method significantly improves the baseline of four pretrained language models and achieves state-of-the-art performance. The model surpasses human performance for the first time on the MuTual dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑