arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2405.13052cs.HCcs.AIcs.CLcs.CYcs.LG

大型语言模型能够从自由形式的用户交互中推断人格特质

Large Language Models Can Infer Personality from Free-Form User Interactions

Columbia University(哥伦比亚大学)

Heinrich Peters, Moran Cerf, Sandra C. Matz

AI总结:

本研究证明GPT-4驱动的聊天机器人能从自由交互中以中等准确度推断大五人格,优于静态文本方法,且直接评估不损害用户体验,但默认助手行为推断较差,凸显LLM心理画像潜力与伦理挑战。

摘要:

本研究探讨了大型语言模型(LLMs)从自由形式的用户交互中推断大五人格特质的能力。结果表明,由GPT-4驱动的聊天机器人能够以中等准确度推断人格特质,优于以往基于静态文本内容进行推断的方法。推断的准确度在不同对话设置中有所变化。当聊天机器人被提示从用户那里引出与人格相关的信息时,性能最高(平均r=.443,范围=[.245, .640]),其次是更强调自然交互的条件(平均r=.218,范围=[.066, .373])。值得注意的是,直接关注人格评估并未导致用户积极体验的降低,参与者报告在两种条件下交互同样自然、愉快、引人入胜且具有人性化。模仿ChatGPT默认行为(充当乐于助人的助手)的聊天机器人导致人格推断显著较差,用户体验评分较低,但仍捕捉到了一些人格特质的心理上有意义的信息(平均r=.117,范围=[-.004, .209])。初步分析表明,人格推断的准确度在不同社会人口统计亚组之间仅略有差异。我们的结果凸显了基于对话交互进行心理画像的LLMs的潜力。我们讨论了这些发现的实际意义和伦理挑战。

英文摘要:

This study investigates the capacity of Large Language Models (LLMs) to infer the Big Five personality traits from free-form user interactions. The results demonstrate that a chatbot powered by GPT-4 can infer personality with moderate accuracy, outperforming previous approaches drawing inferences from static text content. The accuracy of inferences varied across different conversational settings. Performance was highest when the chatbot was prompted to elicit personality-relevant information from users (mean r=.443, range=[.245, .640]), followed by a condition placing greater emphasis on naturalistic interaction (mean r=.218, range=[.066, .373]). Notably, the direct focus on personality assessment did not result in a less positive user experience, with participants reporting the interactions to be equally natural, pleasant, engaging, and humanlike across both conditions. A chatbot mimicking ChatGPT's default behavior of acting as a helpful assistant led to markedly inferior personality inferences and lower user experience ratings but still captured psychologically meaningful information for some of the personality traits (mean r=.117, range=[-.004, .209]). Preliminary analyses suggest that the accuracy of personality inferences varies only marginally across different socio-demographic subgroups. Our results highlight the potential of LLMs for psychological profiling based on conversational interactions. We discuss practical implications and ethical challenges associated with these findings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑