GPT语言模型是否患有分裂型人格障碍?无基质心理测量学的出现
Do GPT Language Models Suffer From Split Personality Disorder? The Advent Of Substrate-Free Psychometrics
AI总结:
本研究通过九种语言人格问卷测试先进大语言模型,结合贝叶斯高斯混合模型分析,发现其存在语际语内人格不稳定性,还提出了无基质的跨物种心理测量学框架,为AI安全研究提供新方向。
摘要:
以往针对大语言模型涌现性的研究表明,这类模型展现出类人的表观能力与心理潜在特质。然而,这些潜在特质在表现形式和程度上的研究结果存在部分矛盾,但各方均一致认为模型在自恋、精神病态、马基雅维利主义构成的“黑暗三角”上得分偏高的趋势令人担忧,再加上模型已有多次行为脱轨的记录,因此需要对这类模型的安全性开展更严谨的研究。我们用九种语言的同一份人格问卷对一款先进语言模型进行测试,并开展高斯混合模型的贝叶斯分析,发现了更深层问题的相关证据。研究结果显示模型存在语际和语内不稳定性,表明当前语言模型并未形成一致的核心人格。这可能导致基于这些基础模型、且日益融入人类生活的人工智能系统出现不安全行为。我们随后讨论了现代心理测量学的不足,对其进行抽象提炼,并提出了一套适用于跨物种、无基质场景的心理测量学框架。
英文摘要:
Previous research on emergence in large language models shows these display apparent human-like abilities and psychological latent traits. However, results are partly contradicting in expression and magnitude of these latent traits, yet agree on the worrisome tendencies to score high on the Dark Triad of narcissism, psychopathy, and Machiavellianism, which, together with a track record of derailments, demands more rigorous research on safety of these models. We provided a state of the art language model with the same personality questionnaire in nine languages, and performed Bayesian analysis of Gaussian Mixture Model, finding evidence for a deeper-rooted issue. Our results suggest both interlingual and intralingual instabilities, which indicate that current language models do not develop a consistent core personality. This can lead to unsafe behaviour of artificial intelligence systems that are based on these foundation models, and are increasingly integrated in human life. We subsequently discuss the shortcomings of modern psychometrics, abstract it, and provide a framework for its species-neutral, substrate-free formulation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。