arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1910.03476cs.CLcs.LG
收藏

分类作为解码器:神经对话中的控制权交易灵活性

Classification As Decoder: Trading Flexibility For Control In Neural Dialogue

Curai

Sam Shleifer, Manish Chablani, Namit Katariya, Anitha Kannan, Xavier Amatriain

摘要:

生成式seq 2seq对话系统被训练来预测已经发生的对话中的下一个单词。他们可以从大型未标记的对话数据集中学习,深入了解对话上下文,并生成各种各样的响应。这种灵活性以控制为代价。训练数据中不需要的响应将在推理时由模型再现,并且较长的代通常没有意义。我们训练一个分类器从预定义的完整响应列表中进行选择,而不是一次生成一个单词的响应。分类器在(会话上下文,响应类)对上进行训练,其中每个响应类是一组可互换的噪声标记响应。在推理时,我们生成与预测的响应类相关联的样例响应。专家可以随着时间的推移编辑和改进这些样本响应,而无需重新训练分类器或使旧的训练数据无效。对775次看不见的医生/患者对话的人类评估表明,这种权衡改善了反应。在相同的对话背景下,只有12%的区别性方法的反应比医生的反应更差,而生成模型的这一比例为18%。在没有对响应类别进行任何手动标记的情况下训练的判别模型实现了与生成模型相同的性能。

英文摘要:

Generative seq2seq dialogue systems are trained to predict the next word in dialogues that have already occurred. They can learn from large unlabeled conversation datasets, build a deep understanding of conversational context, and generate a wide variety of responses. This flexibility comes at the cost of control. Undesirable responses in the training data will be reproduced by the model at inference time, and longer generations often don't make sense. Instead of generating responses one word at a time, we train a classifier to choose from a predefined list of full responses. The classifier is trained on (conversation context, response class) pairs, where each response class is a noisily labeled group of interchangeable responses. At inference, we generate the exemplar response associated with the predicted response class. Experts can edit and improve these exemplar responses over time without retraining the classifier or invalidating old training data. Human evaluation of 775 unseen doctor/patient conversations shows that this tradeoff improves responses. Only 12% of our discriminative approach's responses are worse than the doctor's response in the same conversational context, compared to 18% for the generative model. A discriminative model trained without any manual labeling of response classes achieves equal performance to the generative model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑