arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2001.10468cs.CLcs.LGcs.NEstat.ML

Incorporating Joint Embeddings into Goal-Oriented Dialogues with Multi-Task Learning

University of Bonn(波恩大学);Fraunhofer IAIS(弗劳恩霍夫应用信息技术研究所)

Firas Kassawat, Debanjan Chaudhuri, Jens Lehmann

英文摘要:

Attention-based encoder-decoder neural network models have recently shown promising results in goal-oriented dialogue systems. However, these models struggle to reason over and incorporate state-full knowledge while preserving their end-to-end text generation functionality. Since such models can greatly benefit from user intent and knowledge graph integration, in this paper we propose an RNN-based end-to-end encoder-decoder architecture which is trained with joint embeddings of the knowledge graph and the corpus as input. The model provides an additional integration of user intent along with text generation, trained with a multi-task learning paradigm along with an additional regularization technique to penalize generating the wrong entity as output. The model further incorporates a Knowledge Graph entity lookup during inference to guarantee the generated output is state-full based on the local knowledge graph provided. We finally evaluated the model using the BLEU score, empirical evaluation depicts that our proposed architecture can aid in the betterment of task-oriented dialogue system`s performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑