arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.10863cs.CLcs.AI

通过潜在特征引导探索 LLM 的人格特质

Exploring the Personality Traits of LLMs through Latent Features Steering

King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);University of Toronto(多伦多大学);Soochow University(苏州大学)

Shu Yang, Shenzhe Zhu, Liang Liu, Lijie Hu, Mengdi Li, Di Wang

AI总结:

本文提出一种无需训练的潜在特征提取与引导方法,在社会决定论框架下解析文化规范、环境压力等因素如何塑造 LLM 人格,并评估其安全影响。

摘要:

大型语言模型(LLM)凭借生成类人文本的能力,显著推动了对话系统和角色扮演智能体的发展。尽管已有研究表明 LLM 能够表现出鲜明且稳定的人格,但这些模型编码并表达特定人格特质的机制仍不清楚。为解决该问题,我们在社会决定论理论框架的指导下,研究 LLM 内部编码的文化规范和环境压力源等多种因素如何塑造其人格特质。受 LLM 可解释性相关工作启发,我们提出一种无需训练的方法,通过提取并引导模型内部与这些因素对应的潜在特征来改变模型行为,从而无需重新训练。此外,我们还分析了这些因素对模型安全的影响,重点从人格视角考察其作用。

英文摘要:

Large language models (LLMs) have significantly advanced dialogue systems and role-playing agents through their ability to generate human-like text. While prior studies have shown that LLMs can exhibit distinct and consistent personalities, the mechanisms through which these models encode and express specific personality traits remain poorly understood. To address this, we investigate how various factors, such as cultural norms and environmental stressors, encoded within LLMs, shape their personality traits, guided by the theoretical framework of social determinism. Inspired by related work on LLM interpretability, we propose a training-free approach to modify the model's behavior by extracting and steering latent features corresponding to factors within the model, thereby eliminating the need for retraining. Furthermore, we analyze the implications of these factors for model safety, focusing on their impact through the lens of personality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑