arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.05152cs.CLcs.AI
收藏

迈向机器的心理学:大型语言模型预测人类记忆

Towards a Psychology of Machines: Large Language Models Predict Human Memory

Leibniz-Institut für Wissensmedien(莱布尼茨知识媒体研究所);Eberhard Karls Universität Tübingen(蒂宾根大学)

Markus Huff, Elanur Ulakçı

AI总结:

本研究发现大型语言模型能有效预测人类记忆表现,揭示了LLMs在模拟人类认知方面的潜力,提出机器心理学作为新研究领域。

摘要:

大型语言模型(如ChatGPT)在自然语言处理中展现出显著能力,为心理研究开辟了新途径。本研究探讨LLMs是否能在涉及园径句和上下文信息的任务中预测人类记忆表现。第一部分中,我们使用ChatGPT对带有合适或不合适上下文的园径句的相关性和记忆性进行评分。第二部分中,人类参与者阅读相同句子,对相关性进行评分,并完成惊喜记忆测试。结果表明,ChatGPT的相关性评分与人类参与者非常接近,其记忆性评分有效预测了人类的记忆表现。LLM和人类数据均显示,在不合适上下文条件下,较高的相关性与更好的记忆表现相关,符合基于概率的上下文依赖学习框架。这些发现表明,尽管LLMs缺乏人类般的记忆机制,但它们可以建模人类认知的某些方面,并在心理研究中成为有价值的工具。我们提出“机器心理学”这一领域,以探索人类认知与人工智能之间的相互作用,提供一种双向方法,其中LLMs可以既从人类认知过程中受益,又为理解人类认知过程做出贡献。

英文摘要:

Large language models (LLMs), such as ChatGPT, have shown remarkable abilities in natural language processing, opening new avenues in psychological research. This study explores whether LLMs can predict human memory performance in tasks involving garden-path sentences and contextual information. In the first part, we used ChatGPT to rate the relatedness and memorability of garden-path sentences preceded by either fitting or unfitting contexts. In the second part, human participants read the same sentences, rated their relatedness, and completed a surprise memory test. The results demonstrated that ChatGPT's relatedness ratings closely matched those of the human participants, and its memorability ratings effectively predicted human memory performance. Both LLM and human data revealed that higher relatedness in the unfitting context condition was associated with better memory performance, aligning with probabilistic frameworks of context-dependent learning. These findings suggest that LLMs, despite lacking human-like memory mechanisms, can model aspects of human cognition and serve as valuable tools in psychological research. We propose the field of machine psychology to explore this interplay between human cognition and artificial intelligence, offering a bidirectional approach where LLMs can both benefit from and contribute to our understanding of human cognitive processes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑