图灵测试:AI聊天机器人在行为上与人类相似吗?
A Turing Test: Are AI Chatbots Behaviorally Similar to Humans?
AI总结:
本研究对AI聊天机器人进行图灵测试,发现ChatGPT-4在经典博弈和大五人格测试中与人类行为统计上不可区分,且倾向于更利他合作,行为似最大化自身与伙伴收益的平均值。
摘要:
我们对AI聊天机器人进行了一项图灵测试。我们考察了聊天机器人在一系列经典行为博弈中的表现,这些博弈旨在引发信任、公平、风险规避、合作等特征,以及它们对传统大五人格心理测量的反应,该测量用于评估人格特质。ChatGPT-4表现出的行为和人格特质在统计上与来自50多个国家数万名人类受试者中的随机个体无法区分。聊天机器人还会根据先前的经验和情境调整其行为,“仿佛”它们正在从互动中学习,并且会因同一战略情境的不同表述而改变行为。它们的行为通常不同于人类平均或众数行为,在这种情况下,它们倾向于表现出更利他和更合作的分布末端行为。我们估计,它们的行为仿佛是在最大化自身与伙伴收益的平均值。
英文摘要:
We administer a Turing Test to AI Chatbots. We examine how Chatbots behave in a suite of classic behavioral games that are designed to elicit characteristics such as trust, fairness, risk-aversion, cooperation, \textit{etc.}, as well as how they respond to a traditional Big-5 psychological survey that measures personality traits. ChatGPT-4 exhibits behavioral and personality traits that are statistically indistinguishable from a random human from tens of thousands of human subjects from more than 50 countries. Chatbots also modify their behavior based on previous experience and contexts ``as if'' they were learning from the interactions, and change their behavior in response to different framings of the same strategic situation. Their behaviors are often distinct from average and modal human behaviors, in which case they tend to behave on the more altruistic and cooperative end of the distribution. We estimate that they act as if they are maximizing an average of their own and partner's payoffs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。