arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.07532cs.CL

探究大语言模型从用户对话中推断人格特质的能力

Investigating Large Language Models in Inferring Personality Traits from User Conversations

Kent State University(肯特州立大学)

Jianfeng Zhu, Ruoming Jin, Karin G. Coifman

AI总结:

本研究评估GPT-4o与GPT-4o mini零样本下从对话推断大五人格的能力,发现先算BFI-10条目得分再推特质的方法更准确,且两模型对抑郁症状群体的特质变化敏感度各有优势,为AI与心理学交叉研究提供基础。

摘要:

大语言模型(LLM)正展现出跨多领域的类人卓越能力,涵盖心理评估领域。本研究评估了LLM——具体为GPT-4o和GPT-4o mini——在零样本提示条件下,能否从用户对话中推断大五人格特质,并生成大五人格量表-10(BFI-10)的条目得分。研究结果显示,加入中间步骤——即在计算特质前先提示生成BFI-10条目得分——相较于直接推断特质,能提升准确率,且与金标准的契合度更高。这种结构化方法凸显了利用心理学框架提升预测精度的重要性。此外,基于抑郁症状存在与否的分组比较显示,模型表现存在差异。参与者被分为两组:存在至少一种抑郁症状的组与无症状组。GPT-4o mini对有症状组中神经质、尽责性等特质的抑郁相关变化敏感度更高,而GPT-4o则在跨组的细微差异解读上更具优势。这些发现凸显了LLM有效分析真实世界心理数据的潜力,为人工智能与心理学交叉领域的跨学科研究提供了宝贵基础。

英文摘要:

Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains, including psychological assessment. This study evaluates whether LLMs, specifically GPT-4o and GPT-4o mini, can infer Big Five personality traits and generate Big Five Inventory-10 (BFI-10) item scores from user conversations under zero-shot prompting conditions. Our findings reveal that incorporating an intermediate step--prompting for BFI-10 item scores before calculating traits--enhances accuracy and aligns more closely with the gold standard than direct trait inference. This structured approach underscores the importance of leveraging psychological frameworks in improving predictive precision. Additionally, a group comparison based on depressive symptom presence revealed differential model performance. Participants were categorized into two groups: those experiencing at least one depressive symptom and those without symptoms. GPT-4o mini demonstrated heightened sensitivity to depression-related shifts in traits such as Neuroticism and Conscientiousness within the symptom-present group, whereas GPT-4o exhibited strengths in nuanced interpretation across groups. These findings underscore the potential of LLMs to analyze real-world psychological data effectively, offering a valuable foundation for interdisciplinary research at the intersection of artificial intelligence and psychology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑