arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2001.06626cs.CLcs.IRcs.LG
收藏

神经对话生成的自适应参数化方法

Adaptive Parameterization for Neural Dialogue Generation

Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Data Science Lab, JD.com(京东数据科学实验室)

Hengyi Cai, Hongshen Chen, Cheng Zhang, Yonghao Song, Xiaofang Zhao, Dawei Yin

摘要:

神经会话系统基于序列到序列(SEQ 2SEQ)范例生成响应。通常,模型配备了一组学习参数,以生成对给定输入上下文的响应。当面对不同的会话,它的适应性是相当有限的,因此,该模型容易产生通用的反应。在这项工作中,我们提出了一个{ \bf Ada} pative { \bf N}eural { \bf D}信息生成模型,\textsc{AdaND},它管理各种会话特定的参数化。对于每个会话,该模型通过参考输入上下文来生成编码器-解码器的参数。特别是,我们提出了两个自适应参数化机制:上下文感知和主题感知参数化机制。上下文感知参数化通过捕获给定上下文的局部语义来直接生成参数。主题感知参数化通过首先推断给定上下文的潜在主题,然后生成关于分布式主题的参数,来实现具有相似主题的会话之间的参数共享。在大规模真实世界对话数据集上进行的大量实验表明,我们的模型在定量指标和人工评估方面都具有优异的性能。

英文摘要:

Neural conversation systems generate responses based on the sequence-to-sequence (SEQ2SEQ) paradigm. Typically, the model is equipped with a single set of learned parameters to generate responses for given input contexts. When confronting diverse conversations, its adaptability is rather limited and the model is hence prone to generate generic responses. In this work, we propose an {\bf Ada}ptive {\bf N}eural {\bf D}ialogue generation model, \textsc{AdaND}, which manages various conversations with conversation-specific parameterization. For each conversation, the model generates parameters of the encoder-decoder by referring to the input context. In particular, we propose two adaptive parameterization mechanisms: a context-aware and a topic-aware parameterization mechanism. The context-aware parameterization directly generates the parameters by capturing local semantics of the given context. The topic-aware parameterization enables parameter sharing among conversations with similar topics by first inferring the latent topics of the given context and then generating the parameters with respect to the distributional topics. Extensive experiments conducted on a large-scale real-world conversational dataset show that our model achieves superior performance in terms of both quantitative metrics and human evaluations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑