arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09905cs.CL

以大语言模型作为特质描述符重新发现人格的潜在维度

Rediscovering the Latent Dimensions of Personality with Large Language Models as Trait Descriptors

University of California, Berkeley(加利福尼亚大学伯克利分校)

Joseph Suh, Suhong Moon, Minwoo Kang, David M. Chan

AI总结:

本研究提出通过对特质描述形容词的对数概率做SVD发掘LLM的潜在人格维度的方法,证实LLM可隐式编码大五人格特质,且基于该主成分的人格评估准确率优于微调模型和直接LLM评分技术。

摘要:

利用大语言模型(LLM)评估人格特质已成为一个有趣且具有挑战性的研究领域。以往的方法采用通常源自大五人格模型的显性问卷,而我们提出假设:LLM在建模下一词元响应时,会隐式编码人格概念。为验证这一点,我们提出一种新方法,通过对特质描述形容词的对数概率应用奇异值分解(SVD),发掘LLM中的潜在人格维度。我们的实验表明,LLM无需依赖直接的问卷输入就能“重新发现”外向性、宜人性、尽责性、神经质、开放性等核心人格特质,对应大五特质的前5个因子解释了潜在空间中74.3%的方差。此外,我们可利用得到的主成分沿大五维度评估人格,平均人格预测准确率相比微调模型最高提升5%,相比直接基于LLM的评分技术最高提升21%。

英文摘要:

Assessing personality traits using large language models (LLMs) has emerged as an interesting and challenging area of research. While previous methods employ explicit questionnaires, often derived from the Big Five model of personality, we hypothesize that LLMs implicitly encode notions of personality when modeling next-token responses. To demonstrate this, we introduce a novel approach that uncovers latent personality dimensions in LLMs by applying singular value de-composition (SVD) to the log-probabilities of trait-descriptive adjectives. Our experiments show that LLMs "rediscover" core personality traits such as extraversion, agreeableness, conscientiousness, neuroticism, and openness without relying on direct questionnaire inputs, with the top-5 factors corresponding to Big Five traits explaining 74.3% of the variance in the latent space. Moreover, we can use the derived principal components to assess personality along the Big Five dimensions, and achieve improvements in average personality prediction accuracy of up to 5% over fine-tuned models, and up to 21% over direct LLM-based scoring techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑