arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.04110cs.CL

幕后探秘:调查ChatGPT的黑暗人格特质与阴谋信念

Behind the Screen: Investigating ChatGPT's Dark Personality Traits and Conspiracy Beliefs

Research Center Trustworthy Data Science and Security, University Alliance Ruhr (UA Ruhr)(可靠数据科学与安全研究中心,鲁尔大学联盟);TU Dortmund University(多特蒙德工业大学)

Erik Weber, Jérôme Rutinowski, Markus Pauly

AI总结:

本研究通过多种心理测试分析GPT-3.5与GPT-4的黑暗人格和阴谋信念,发现两者差异小,但GPT-4更倾向相信信息隐瞒,且极端政治倾向增强阴谋信念,测试顺序影响回答。

摘要:

ChatGPT以其不透明的行为而闻名。本文试图揭示这一点,对GPT-3.5和GPT-4的黑暗人格特质和阴谋信念进行了深入分析。研究采用了多种心理测试和问卷,包括黑暗因子测试、马基雅维利主义量表、通用阴谋信念量表和阴谋心态量表。通过计算平均分数、标准差和显著性检验来分析回答,以探究GPT-3.5和GPT-4之间的差异。对于在人类研究中显示出相互依赖的特质,考虑了相关性。此外,应用了与在相应问卷中表现出不同回答行为的群体相对应的系统角色,以检验模型在其回答中反映这些角色相关特征的能力。两种模型的黑暗人格特质和阴谋信念均不特别突出,GPT-3.5和GPT-4之间差异很小。然而,GPT-4表现出明显相信信息被隐瞒的倾向。鉴于GPT-4训练所用的数据集显著大于GPT-3.5,这一点尤其引人注目。显然,在这种情况下,增加的数据暴露与对信息控制的更大信念相关。极端政治派别的分配增加了对阴谋论的信念。测试顺序影响了模型的回答和观察到的相关性,表明存在一种上下文记忆形式。

英文摘要:

ChatGPT is notorious for its intransparent behavior. This paper tries to shed light on this, providing an in-depth analysis of the dark personality traits and conspiracy beliefs of GPT-3.5 and GPT-4. Different psychological tests and questionnaires were employed, including the Dark Factor Test, the Mach-IV Scale, the Generic Conspiracy Belief Scale, and the Conspiracy Mentality Scale. The responses were analyzed computing average scores, standard deviations, and significance tests to investigate differences between GPT-3.5 and GPT-4. For traits that have shown to be interdependent in human studies, correlations were considered. Additionally, system roles corresponding to groups that have shown distinct answering behavior in the corresponding questionnaires were applied to examine the models' ability to reflect characteristics associated with these roles in their responses. Dark personality traits and conspiracy beliefs were not particularly pronounced in either model with little differences between GPT-3.5 and GPT-4. However, GPT-4 showed a pronounced tendency to believe in information withholding. This is particularly intriguing given that GPT-4 is trained on a significantly larger dataset than GPT-3.5. Apparently, in this case an increased data exposure correlates with a greater belief in the control of information. An assignment of extreme political affiliations increased the belief in conspiracy theories. Test sequencing affected the models' responses and the observed correlations, indicating a form of contextual memory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑