arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.10006cs.CLcs.AI

Orca:通过整合人格特质增强大型语言模型的角色扮演能力

Orca: Enhancing Role-Playing Abilities of Large Language Models by Integrating Personality Traits

College of Software(软件学院);Jilin University(吉林大学)

Yuxuan Huang

AI总结:

本文提出Orca框架,通过整合大五人格特质的数据处理与训练流程,显著提升大型语言模型在角色扮演任务中的能力,并发布首个多规模社交平台内容评估基准OrcaBench。

摘要:

大型语言模型催化了个性化对话系统的发展,涌现出众多角色扮演对话智能体。以往研究主要侧重于通过设计角色档案来增强模型遵循指令的能力,却忽视了驱动人类对话的心理因素。本文提出Orca,一个通过整合人格特质进行数据处理和定制角色LLM训练的框架。Orca包含四个阶段:(1)人格特质推断,利用LLM推断用户的大五人格特质报告和得分。(2)数据增强,模拟用户的档案、背景故事和心理活动。(3)数据集构建,使用人格条件化指令提示(PCIP)来激发LLM。(4)建模与训练,进行人格条件化指令微调(PTIT和PSIT),利用生成的数据增强现有开源LLM。我们引入OrcaBench,这是首个用于评估跨多个规模LLM在社交平台上生成内容质量的基准。实验表明,我们提出的模型在该基准上取得了卓越性能,证明其在感知人格特质方面的优异性和有效性,从而显著提升角色扮演能力。代码可在 https://github.com/Aipura/Orca 获取。

英文摘要:

Large language models has catalyzed the development of personalized dialogue systems, numerous role-playing conversational agents have emerged. While previous research predominantly focused on enhancing the model's capability to follow instructions by designing character profiles, neglecting the psychological factors that drive human conversations. In this paper, we propose Orca, a framework for data processing and training LLMs of custom characters by integrating personality traits. Orca comprises four stages: (1) Personality traits inferring, leverage LLMs to infer user's BigFive personality trait reports and scores. (2) Data Augment, simulate user's profile, background story, and psychological activities. (3) Dataset construction, personality-conditioned instruction prompting (PCIP) to stimulate LLMs. (4) Modeling and Training, personality-conditioned instruction tuning (PTIT and PSIT), using the generated data to enhance existing open-source LLMs. We introduce OrcaBench, the first benchmark for evaluating the quality of content generated by LLMs on social platforms across multiple scales. Our experiments demonstrate that our proposed model achieves superior performance on this benchmark, demonstrating its excellence and effectiveness in perceiving personality traits that significantly improve role-playing abilities. Our Code is available at https://github.com/Aipura/Orca.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑