值得学习的测试:为响应选择训练生成有价值的负样本
Challenging Instances are Worth Learning: Generating Valuable Negative Samples for Response Selection Training
摘要:
基于检索的聊天机器人根据上下文从候选者中选择适当的响应,这在很大程度上取决于响应选择模块。响应选择模块通常是用于评估候选者的评分模型,并且通常在注释的积极响应和采样的消极响应上进行训练。对阴性响应进行抽样会导致两种风险:a)。抽样的否定实例,特别是随机抽样方法的否定实例,大多与对话上下文无关,并且在训练阶段太容易拟合,同时导致在真实场景中的弱模型。(b)。所谓的负实例可能是正的,这就是所谓的假负问题。为了解决上述问题,我们采用预训练的语言模型,如DialoGPT来构建更具挑战性的否定实例,以增强模型的鲁棒性。具体来说,我们为预训练模型提供乱码上下文以生成响应并过滤假的负面响应。这样,我们的负面实例是流畅的,上下文相关的,更具有挑战性的模型学习,而不能是积极的。大量的实验表明,我们的方法带来了显着的和稳定的对话响应选择能力的改善。
英文摘要:
Retrieval-based chatbot selects the appropriate response from candidates according to the context, which heavily depends on a response selection module. A response selection module is generally a scoring model to evaluate candidates and is usually trained on the annotated positive response and sampled negative responses. Sampling negative responses lead to two risks: a). The sampled negative instances, especially that from random sampling methods, are mostly irrelevant to the dialogue context and too easy to be fitted at the training stage while causing a weak model in the real scenario. b). The so-called negative instances may be positive, which is known as the fake negative problem. To address the above issue, we employ pre-trained language models, such as the DialoGPT to construct more challenging negative instances to enhance the model robustness. Specifically, we provide garbled context to the pre-trained model to generate responses and filter the fake negative ones. In this way, our negative instances are fluent, context-related, and more challenging for the model to learn, while can not be positive. Extensive experiments show that our method brings significant and stable improvements on the dialogue response selection capacity.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。