arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.07363cs.CL

PersonalityChat:基于事实与特质进行个性化对话建模的对话蒸馏

PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits

CLiPS Research Center(CLiPS研究中心);University of Antwerp(安特卫普大学)

Ehsan Lotfi, Maxime De Bruyn, Jeska Buhmann, Walter Daelemans

AI总结:

本文利用大语言模型构建了同时以人物设定和大五人格特质为条件的合成对话数据集PersonalityChat,并证明基于该数据集微调可在小模型条件下实现更流畅、更连贯的个性化对话智能体。

摘要:

新一轮大语言模型(LLM)浪潮为构建大规模对话数据集提供了高效工具。迄今为止,研究主要集中于任务导向或通用开放域对话,尚未充分探索LLM在遵循复杂提示方面的能力。在本工作中,我们聚焦个性化,并利用LLM构建一个难以且成本高昂地通过众包获得的数据集:PersonalityChat是一个基于流行的PersonaChat数据集生成的合成对话数据集,但同时以人物设定和(大五)人格特质为条件。通过对在该数据集上微调的模型进行评估,我们表明人格特质标签可用于生成式对话模型的基于特质的个性化。我们还对PersonalityChat与PersonaChat进行了直接对比,结果表明在小模型条件下,基于该蒸馏数据集训练能够产生更流畅、更连贯的对话智能体。

英文摘要:

The new wave of Large Language Models (LLM) has offered an efficient tool to curate sizeable conversational datasets. So far studies have mainly focused on task-oriented or generic open-domain dialogs, and have not fully explored the ability of LLMs in following complicated prompts. In this work, we focus on personalization, and employ LLMs to curate a dataset which is difficult and costly to crowd-source: PersonalityChat is a synthetic conversational dataset based upon the popular PersonaChat dataset, but conditioned on both personas and (Big-5) personality traits. Evaluating models fine-tuned on this dataset, we show that the personality trait labels can be used for trait-based personalization of generative dialogue models. We also perform a head-to-head comparison between PersonalityChat and PersonaChat, and show that training on the distilled dataset results in more fluent and coherent dialog agents in the small-model regime.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑