Large language models (LLMs), such as ChatGPT, have shown remarkable abilities in natural language processing, opening new avenues in psychological research. This study explores whether LLMs can predict human memory performance in tasks involving garden-path sentences and contextual information. In the first part, we used ChatGPT to rate the relatedness and memorability of garden-path sentences preceded by either fitting or unfitting contexts. In the second part, human participants read the same sentences, rated their relatedness, and completed a surprise memory test. The results demonstrated that ChatGPT's relatedness ratings closely matched those of the human participants, and its memorability ratings effectively predicted human memory performance. Both LLM and human data revealed that higher relatedness in the unfitting context condition was associated with better memory performance, aligning with probabilistic frameworks of context-dependent learning. These findings suggest that LLMs, despite lacking human-like memory mechanisms, can model aspects of human cognition and serve as valuable tools in psychological research. We propose the field of machine psychology to explore this interplay between human cognition and artificial intelligence, offering a bidirectional approach where LLMs can both benefit from and contribute to our understanding of human cognitive processes.
Mind meets machine: Unravelling GPT-4's cognitive psychology
Nowrosjee Wadia College(诺罗斯吉·瓦迪亚学院);Indian Institute of Tropical Meteorology(印度热带气象研究所);Defence Institute Of Advanced Technology(国防先进技术研究所);Queen Mary University of London(伦敦玛丽女王大学)
CogniDual Framework: Self-Training Large Language Models within a Dual-System Theoretical Framework for Improving Cognitive Tasks
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science(上海工程技术大学电子与电气工程学院);INF Technology (shanghai) Co., Ltd.(INF科技(上海)有限公司);School of Art, Design and Architecture, Monash University(莫纳什大学艺术、设计与建筑学院);Artificial Intelligence Innovation and Incubation Institute, Fudan University(复旦大学人工智能创新与孵化研究院)
Assessing Episodic Memory in LLMs with Sequence Order Recall Tasks
Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所);Intel Labs(英特尔实验室);University of Texas at Austin(德克萨斯大学奥斯汀分校);Princeton University(普林斯顿大学);Princeton Neuroscience Institute(普林斯顿神经科学研究所);New York University(纽约大学)
Math anxiety and associative knowledge structure are entwined in psychology students but not in Large Language Models like GPT-3.5 and GPT-4o
Department of Psychology and Cognitive Science, University of Trento(心理学与认知科学系,特伦托大学);CogNosco Lab, Department of Psychology and Cognitive Science, University of Trento(CogNosco实验室,心理学与认知科学系,特伦托大学);Technical University of Munich(慕尼黑技术大学);Munich Data Science Institute(慕尼黑数据科学研究所);Centre for Change and Complexity in Learning, University of South Australia(学习变革与复杂性研究中心,澳大利亚南澳大利亚大学)
Beyond Text: Leveraging Multi-Task Learning and Cognitive Appraisal Theory for Post-Purchase Intention Analysis
Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究院);Birla Institute of Technology and Science(贝拉理工与科学学院);NUS Centre for Trusted Internet and Community, National University of Singapore(新加坡国立大学可信互联网与社区中心)
BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions
University of Surrey(萨里大学);ETH Zurich(苏黎世联邦理工学院);University of Lausanne(洛桑大学);University of Zurich(苏黎世大学);University of Konstanz(康斯坦茨大学);University of St. Gallen(圣加仑大学)