arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.22309cs.HCcs.CY
收藏

GPT-4o解读他人眼神

GPT-4o reads the mind in the eyes

University Medical Center Hamburg-Eppendorf(汉堡-埃彭多夫大学医学中心);Italian Institute of Technology(意大利理工学院);University of Turin(都灵大学);Indeep Artificial Intelligence(Indeep人工智能);Massachusetts Institute of Technology(麻省理工学院);Harbin Institute of Technology(哈尔滨工业大学);Princeton University(普林斯顿大学)
James W. A. Strachan, Oriana Pansardi, Eugenio Scaliti, Marco Celotto, Krati Saxena, Chunzhi Yi, Fabio Manzi, Alessandro Rufo, Guido Manzi, Michael S. A. Grazia… 展开作者

James W. A. Strachan, Oriana Pansardi, Eugenio Scaliti, Marco Celotto, Krati Saxena, Chunzhi Yi, Fabio Manzi, Alessandro Rufo, Guido Manzi, Michael S. A. Graziano, Stefano Panzeri, Cristina Becchio

AI总结:

研究探讨GPT-4o在解读面部情绪与心理状态的能力,发现其在直立面孔上表现优于人类,但在倒置面孔上表现欠佳,且对白人面孔的解读更准确。

摘要:

大型语言模型(LLMs)能够模仿人类推理,包括从文本中推断情绪和心理状态。是否这种能力能扩展到其他模态仍不明确。人类具备解读他人眼神中的心理状态的复杂能力。本文测试GPT-4o是否具备这种能力。使用两种广泛使用的心理理论测试,即《解读眼神测试》和《多种族解读眼神测试》,发现GPT-4o在解读直立面孔的心理状态时优于人类,但在倒置面孔时表现较差。尽管样本中人类对白人和非白人面孔无差异,GPT-4o在白人面孔上的准确性更高。GPT-4o的错误并非随机,而是显示出高度一致但错误的处理心理状态信息的方式,其错误结构具有方向依赖性,与人类在倒置面孔上的错误结构不同,但在直立面孔上相同。这些发现突显了GPT-4o在心理状态推理能力及人类样式的面孔处理特征,如倒置效应,与人类存在显著差异。

英文摘要:

Large Language Models (LLMs) are capable of reproducing human-like inferences, including inferences about emotions and mental states, from text. Whether this capability extends beyond text to other modalities remains unclear. Humans possess a sophisticated ability to read the mind in the eyes of other people. Here we tested whether this ability is also present in GPT-4o, a multimodal LLM. Using two versions of a widely used theory of mind test, the Reading the Mind in Eyes Test and the Multiracial Reading the Mind in the Eyes Test, we found that GPT-4o outperformed humans in interpreting mental states from upright faces but underperformed humans when faces were inverted. While humans in our sample showed no difference between White and Non-white faces, GPT-4o's accuracy was higher for White than for Non-white faces. GPT-4o's errors were not random but revealed a highly consistent, yet incorrect, processing of mental-state information across trials, with an orientation-dependent error structure that qualitatively differed from that of humans for inverted faces but not for upright faces. These findings highlight how advanced mental state inference abilities and human-like face processing signatures, such as inversion effects, coexist in GPT-4o alongside substantial differences in information processing compared to humans.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑