Despite being designed for performance rather than cognitive plausibility, transformer language models have been found to be better at predicting metrics used to assess human language comprehension than language models with other architectures, such as recurrent neural networks. Based on how well they predict the N400, a neural signal associated with processing difficulty, we propose and provide evidence for one possible explanation - their predictions are affected by the preceding context in a way analogous to the effect of semantic facilitation in humans.
Decoding Emotions in Abstract Art: Cognitive Plausibility of CLIP in Recognizing Color-Emotion Associations
Institute for Interdisciplinary Studies, University of Amsterdam（阿姆斯特丹大学跨学科研究所）；Department of Information and Computing Sciences, Utrecht University（乌得勒支大学信息与计算科学系）
Bridging LSTM Architecture and the Neural Dynamics during Reading
Shanghai Key Laboratory of Intelligent Information Processing, Fudan University（复旦大学上海市智能信息处理重点实验室）；School of Computer Science, Fudan University（复旦大学计算机科学技术学院）
Spontaneous Speech Variables for Evaluating LLMs Cognitive Plausibility
Academia Sinica Institute of Linguistics（学术院语言研究所）；CNRS & MEAE CEFC（国家科学研究中心与外交与国际合作部CEFC）；Graduate Institute of Linguistics National Taiwan University（国立台湾大学语言研究所）；Department of CSIE National Taiwan University（国立台湾大学计算机科学系）
Tabula nearly rasa: Probing the Linguistic Knowledge of Character-Level Neural Language Models Trained on Unsegmented Text
Stanford University（斯坦福大学）；Facebook AI Research（脸书人工智能研究院）；UPF Linguistics Department（庞培法布拉大学语言学系）
递归神经网络（RNN）在许多自然语言处理任务中取得了惊人的性能。这重新引起了人们对这些通用序列处理设备是否诱导真正的语言知识的兴趣。然而，几乎所有当前的分析研究都用已知单词的词汇表初始化RNN，并在训练过程中为它们提供标记化的输入。我们提出了一个多语言的语言知识编码的RNN训练字符级语言模型，在输入数据与词边界删除的研究。这些网络面临着一个更艰难、更现实的认知任务，必须根据输入统计数据从头开始发现任何有用的语言单元。结果表明，我们的“near tabula rasa”RNN大多能够解决直观地假设单词级别知识的形态，句法和语义任务，并且确实在某种程度上学会了跟踪单词边界。我们的研究为语言学习和使用中明确的、严格的词汇库的必要性的思考打开了大门。
Language Models Explain Word Reading Times Better Than Empirical Predictability
University of Wuppertal（伍珀塔尔大学）；Universität Hamburg（汉堡大学）；International Psychoanalytic University（国际精神分析大学）；University of Exeter（埃克塞特大学）；The University of Sydney（悉尼大学）；McGill University（麦吉尔大学）；Washington University in St. Louis（圣路易斯华盛顿大学）；Indiana University（印第安纳大学）
