Thanos:注入心智技能的大型语言模型增强对话代理
Thanos: Enhancing Conversational Agents with Skill-of-Mind-Infused Large Language Model
AI总结:
本文提出心智技能数据集及Thanos模型系列,通过注入多面对话技能,显著提升LLM对话代理的回应质量与亲社会行为。
摘要:
为了增进与对话者的社会联系,人类自然地获得了在特定情境下通过考虑哪种对话技能最适合回应来做出恰当反应的能力——我们将这一过程称为心智技能。对于基于大型语言模型(LLM)的对话代理而言,像人类一样规划恰当的对话技能,由于社交对话的复杂性,尤其是在交互式场景中,是一项挑战。为解决这一问题,我们提出了一个名为多面心智技能的心智技能标注对话数据集,该数据集涵盖了多种交互场景(如长期对话、咨询、任务导向)中的多轮、多面对话技能,并基于多样的社会背景(如人口统计特征、人格、经验法则)。该数据集包含约10万次对话。利用该数据集,我们推出了一个新系列的心智技能注入型大型语言模型,命名为Thanos,模型规模为1B、3B和8B参数。通过大量实验,这些模型成功展示了心智技能过程,并在跨多个领域推断多面技能方面表现出强大的泛化能力。此外,我们表明Thanos显著提升了基于LLM的对话代理生成回复的质量,并在人工评估中促进了亲社会行为。
英文摘要:
To increase social bonding with interlocutors, humans naturally acquire the ability to respond appropriately in a given situation by considering which conversational skill is most suitable for the response - a process we call skill-of-mind. For large language model (LLM)-based conversational agents, planning appropriate conversational skills, as humans do, is challenging due to the complexity of social dialogue, especially in interactive scenarios. To address this, we propose a skill-of-mind-annotated conversation dataset, named Multifaceted Skill-of-Mind, which includes multi-turn and multifaceted conversational skills across various interactive scenarios (e.g., long-term, counseling, task-oriented), grounded in diverse social contexts (e.g., demographics, persona, rules of thumb). This dataset consists of roughly 100K conversations. Using this dataset, we introduce a new family of skill-of-mind-infused LLMs, named Thanos, with model sizes of 1B, 3B, and 8B parameters. With extensive experiments, these models successfully demonstrate the skill-of-mind process and exhibit strong generalizability in inferring multifaceted skills across a variety of domains. Moreover, we show that Thanos significantly enhances the quality of responses generated by LLM-based conversational agents and promotes prosocial behavior in human evaluations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。