动词和论元在人脑中表征的组合性质
The Compositional Nature of Verb and Argument Representations in the Human Brain
摘要:
人类的大脑是如何表现物体、演员和动作的简单组合的?我们让受试者在神经成像(fMRI)会议期间观看动作序列视频,并通过解码(SVM)仅基于其fMRI激活模式的大脑表征来识别这些视频的词汇描述。作为这一结果的先驱,我们已经证明,我们可以可靠地和高概率地解码对应于六个动作视频(挖掘,步行等)之一的动作标签,再次,而受试者在扫描(功能磁共振成像)过程中观看动作序列。该结果在两个不同的脑成像部位用共同的协议但不同的受试者进行了复制,显示了共同的脑区域,包括已知的情景记忆区域(PHG、MTL、高水平视觉通路等,即“什么”和“哪里”系统,以及TPJ,即“心理理论”)。鉴于这些结果,我们也能够成功地展示基于对象类和演员身份的同时解码的语言组合性的一个关键方面。最后,将这些新颖的步骤结合在“大脑阅读”中,使我们能够准确地估计大脑表征,以支持对由演员、动词、方向和对象组成的复杂事件的合成解码。
英文摘要:
How does the human brain represent simple compositions of objects, actors,and actions? We had subjects view action sequence videos during neuroimaging (fMRI) sessions and identified lexical descriptions of those videos by decoding (SVM) the brain representations based only on their fMRI activation patterns. As a precursor to this result, we had demonstrated that we could reliably and with high probability decode action labels corresponding to one of six action videos (dig, walk, etc.), again while subjects viewed the action sequence during scanning (fMRI). This result was replicated at two different brain imaging sites with common protocols but different subjects, showing common brain areas, including areas known for episodic memory (PHG, MTL, high level visual pathways, etc.,i.e. the 'what' and 'where' systems, and TPJ, i.e. 'theory of mind'). Given these results, we were also able to successfully show a key aspect of language compositionality based on simultaneous decoding of object class and actor identity. Finally, combining these novel steps in 'brain reading' allowed us to accurately estimate brain representations supporting compositional decoding of a complex event composed of an actor, a verb, a direction, and an object.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。