arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.09355cs.CLcs.AI
收藏

每个人一个聊天机器人:基于隐式用户简档创建个性化聊天机器人

One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profiles

Renmin University of China(中国人民大学);Beijing Key Laboratory of Big Data Management and Analysis Methods(大数据管理与分析方法北京市重点实验室);Key Laboratory of Data Engineering and Knowledge Engineering, MOE(教育部数据工程与知识工程重点实验室);Université de Montréal(蒙特利尔大学)

Zhengyi Ma, Zhicheng Dou, Yutao Zhu, Hanxun Zhong, Ji-Rong Wen

摘要:

个性化聊天机器人专注于赋予聊天机器人一致的个性,以表现得像真实用户一样,提供更多信息的响应,并进一步充当个人助理。现有的个性化方法试图将几个文本描述作为显式的用户简档。然而,这种显式配置文件的获取是昂贵和耗时的,因此对于大规模的现实世界的应用是不切实际的。此外,受限的预定义简档忽略了真实用户的语言行为,并且不能随着用户兴趣的改变而自动更新。在本文中,我们提出了从大规模用户对话历史中自动学习隐式用户简档,以构建个性化聊天机器人。具体而言,利用Transformer在语言理解方面的优势,我们训练个性化的语言模型,以根据用户的历史响应构建通用的用户简档。为了突出对输入帖子的相关历史响应,我们进一步建立了历史后响应对的键值记忆网络,并构建了动态的帖子感知用户简档。动态配置文件主要描述用户在历史中对类似帖子的响应以及如何响应。为了明确地利用用户的常用词,我们设计了一个个性化的解码器,融合两种解码策略,包括从通用词汇表中生成一个词和从用户的个性化词汇表中复制一个词。在两个真实数据集上的实验表明,与现有的方法相比,我们的模型有显着的改善。我们的代码可在https://github.com/zhengyima/DHAP上获得

英文摘要:

Personalized chatbots focus on endowing chatbots with a consistent personality to behave like real users, give more informative responses, and further act as personal assistants. Existing personalized approaches tried to incorporate several text descriptions as explicit user profiles. However, the acquisition of such explicit profiles is expensive and time-consuming, thus being impractical for large-scale real-world applications. Moreover, the restricted predefined profile neglects the language behavior of a real user and cannot be automatically updated together with the change of user interests. In this paper, we propose to learn implicit user profiles automatically from large-scale user dialogue history for building personalized chatbots. Specifically, leveraging the benefits of Transformer on language understanding, we train a personalized language model to construct a general user profile from the user's historical responses. To highlight the relevant historical responses to the input post, we further establish a key-value memory network of historical post-response pairs, and build a dynamic post-aware user profile. The dynamic profile mainly describes what and how the user has responded to similar posts in history. To explicitly utilize users' frequently used words, we design a personalized decoder to fuse two decoding strategies, including generating a word from the generic vocabulary and copying one word from the user's personalized vocabulary. Experiments on two real-world datasets show the significant improvement of our model compared with existing methods. Our code is available at https://github.com/zhengyima/DHAP

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑