The ability to represent oneself and others as agents with knowledge, intentions, and belief states that guide their behavior - Theory of Mind - is a human universal that enables us to navigate - and manipulate - the social world. It is supported by our ability to form mental models of ourselves and others. Its ubiquity in human affairs entails that LLMs have seen innumerable examples of it in their training data and therefore may have learned to mimic it, but whether they have actually learned causal models that they can deploy in arbitrary settings is unclear. We therefore develop a novel experimental paradigm that requires that subjects form representations of the mental states of themselves and others and act on them strategically rather than merely describe them. We test a wide range of leading open and closed source LLMs released since 2024, as well as human subjects, on this paradigm. We find that 1) LLMs released before mid-2025 fail at all of our tasks, 2) more recent LLMs achieve human-level performance on modeling the cognitive states of others, and 3) even frontier LLMs fail at our self-modeling task - unless afforded a scratchpad in the form of a reasoning trace. We further demonstrate cognitive load effects on other-modeling tasks, offering suggestive evidence that LLMs are using something akin to limited-capacity working memory to hold these mental representations in mind during a single forward pass. Finally, we explore the mechanisms by which reasoning models succeed at the self- and other-modeling tasks, and show that they readily engage in strategic deception.
Theory of Mind and Self-Attributions of Mentality are Dissociable in LLMs
Google, Paradigms of Intelligence Team(Google,智能范式团队);Knowledge Lab, University of Chicago(芝加哥大学知识实验室);Institute of Philosophy, School of Advanced Study, University of London(伦敦大学高等研究院哲学研究所);Department of Biomedical Informatics and Medical Education and Department of Bioethics and Humanities, School of Medicine, University of Washington(华盛顿大学医学院生物医学信息学与医学教育系及生物伦理学与人文学系);Kellogg School of Management, Northwestern University(西北大学凯洛格管理学院);Santa Fe Institute(圣塔菲研究所)
MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Intervention
Tsinghua University(清华大学);University of Washington(华盛顿大学);Beijing University of Posts and Telecommunications(北京邮电大学);Massachusetts Institute of Technology(麻省理工学院)
Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States
UC San Diego(加州大学圣迭戈分校);KU Leuven(鲁汶大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);The Ohio State University(俄亥俄州立大学);Johns Hopkins University(约翰斯·霍普金斯大学)
Mind over Space: Can Multimodal Large Language Models Mentally Navigate?
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);Dept. of Comp. Sci. and Tech., Institute for AI, Tsinghua-Bosch Joint ML Center, THBI Lab, BNRist Center, Tsinghua University(清华大学-博世联合机器学习中心、THBI实验室、BNRist中心、清华大学计算机科学与技术系);School of Automation Science and Electrical Engineering , Beihang University(北京航空航天大学自动化科学与电气工程学院);college of AI, Tsinghua University(清华大学人工智能学院);Department of Computer Science and Technology , Tsinghua University(清华大学计算机科学与技术系)
CoMMET: A Psychologically Grounded Benchmark for Evaluating Theory of Mind in Multimodal LLMs
Agency for Science, Technology and Research (A*STAR)(科技研究局);Nanyang Technological University(南洋理工大学);Hong Kong University of Science and Technology (Guangzhou), China(香港科技大学(广州),中国)
XToM: Exploring the Multilingual Theory of Mind for Large Language Models
HKUST, Hong Kong(香港理工大学);NVIDIA AI Technology Center (NVAITC), USA(NVIDIA AI技术中心(NVAITC));Shanghai Jiao Tong University, China(上海交通大学);Technische Universtität Darmstadt, Germany(德累斯顿技术大学);LMU Munich, Germany(慕尼黑大学);Munich Center for Machine Learning, Germany(慕尼黑机器学习中心)
Theory of Mind in Large Language Models: Assessment and Enhancement
Agency for Science Technology and Research (A*STAR)(科技研究局);Nanyang Technological University(南洋理工大学);Hong Kong University of Science and Technology (Guangzhou) China(香港科学与技术大学(广州)中国)
PersuasiveToM: A Benchmark for Evaluating Machine Theory of Mind in Persuasive Dialogues
National Key Laboratory for Novel Software Technology, Nanjing University, China(南京大学新型软件技术国家重点实验室);School of Artificial Intelligence, Nanjing University, China(南京大学人工智能学院);Department of Computer Science and Engineering, Shanghai Jiao Tong University(上海交通大学计算机科学与工程系);University of California, San Diego, CA, USA(美国加州大学圣地亚哥分校)
Visual serial processing deficits explain divergences in human and VLM reasoning
Princeton Neuroscience Institute(普林斯顿神经科学研究所);Department of Psychology, Princeton University(普林斯顿大学心理学系);Department of Psychology, Université de Montréal(蒙特利尔大学心理学系);Mila - Quebec AI Institute(魁北克AI研究所);Department of Computer Science, Princeton University(普林斯顿大学计算机科学系)
MMToM-QA: Multimodal Theory of Mind Question Answering
New York University(纽约大学);Harvard University(哈佛大学);Massachusetts Institute of Technology(麻省理工学院);UC San Diego(加州大学圣迭戈分校);University of Virginia(弗吉尼亚大学);Johns Hopkins University(约翰斯·霍普金斯大学)
Towards Machine Theory of Mind with Large Language Model-Augmented Inverse Planning
Department of Psychology, University of Toronto(多伦多大学心理学系);Vector Institute(向量研究所);Schwartz Reisman Institute of Technology & Society, University of Toronto(多伦多大学科技与社会研究所);Department of Computer Science, University of Toronto(多伦多大学计算机科学系)
MindScape Study: Integrating LLM and Behavioral Sensing for Personalized AI-Driven Journaling Experiences
Dartmouth College(达特茅斯学院);Colby College(科尔比学院);Brown University(布朗大学);Cornell Tech(康奈尔科技学院);Massachusetts Institute of Technology(麻省理工学院);University College London(伦敦大学学院);Biocogniv Inc(比奥认知公司);University of California, San Diego(加利福尼亚大学圣迭戈分校);Microsoft Research(微软研究院)
Do Large Language Models Have a Planning Theory of Mind? Evidence from MindGames: a Multi-Step Persuasion Task
Stanford University(斯坦福大学);Australian National University(澳大利亚国立大学);University of St. Andrews(圣安德鲁斯大学);University of Cambridge(剑桥大学);University of California, San Diego(加利福尼亚大学圣地亚哥分校)
Deflating Deflationism: A Critical Perspective on Debunking Arguments Against LLM Mentality
Institute of Philosophy, University of London(伦敦大学哲学学院);Google, Paradigms of Intelligence Team(谷歌、智能范式团队);Leverhulme Centre for the Future of Intelligence, University of Cambridge(未来智能研究中心、剑桥大学)
Do Large Language Models Possess a Theory of Mind? A Comparative Evaluation Using the Strange Stories Paradigm
ELTE Research Centre for Linguistics(ELTE语言学研究中心);Department of Cognitive Science, Faculty of Natural Sciences, Budapest University of Technology and Economics(布达佩斯技术与经济大学自然科学学院认知科学系);Institute of Mathematics, Eötvös Lóránd University(欧多布雷尼大学数学研究所)
Mind Your Theory: Theory of Mind Goes Deeper Than Reasoning
Hebrew University of Jerusalem(海法大学);MPI for Biological Cybernetics(生物感知研究所);Centre for AI and Machine Learning, AU(人工智能与机器学习中心);IoPPN, King’s College London(国王学院伦敦人工智能与感知神经科学中心)
Learning Dynamic Belief Graphs for Theory-of-mind Reasoning
Department of Civil;Systems Engineering, Johns Hopkins University, Baltimore, MD, USA;School of the Environment, Society \& Sustainability, University of Utah, Salt Lake City, UT, USA;Department of Psychology, University of Utah, Salt Lake City, UT, USA;Coastal Engineering, University of Florida, Gainesville, FL, USA