惊异度的分解:语言处理中ERP成分的统一计算模型
Decomposition of surprisal: Unified computational model of ERP components in language processing
AI总结:
提出一种人脑语言处理的信息论模型,将上下文中词的信息内容(surprisal)分解为对应N400的浅层惊异度和对应P600的深层惊异度,利用现代NLP模型估计二者,成功模拟并预测了六项实验的ERP模式。
摘要:
几十年来,语言相关ERP成分的功能解释一直是心理语言学领域争论的核心。我们提出了一种关于人脑语言处理的信息论模型,在该模型中,输入的语言信息首先进行浅层处理,随后进行更深层的处理,这两种信息处理对应于不同的脑电特征。在形式上,我们证明了上下文中一个词的信息内容(surprisal)可以分解为两个量:(A)浅层惊异度,表示一个词的浅层处理难度,与N400信号相对应;以及(B)深层惊异度,反映浅层与深层表征之间的差异,与P600信号及其他晚期正波相对应。这两个量均可以使用现代NLP模型直接进行估计。我们通过成功模拟六项实验中先前报告的实验数据里由各种语言操作引发的ERP模式,并给出了成功的新颖定性和定量预测,从而验证了我们的理论。我们的理论与假设存在“足够好”的浅层表征阶段这一传统认知理论相兼容,但提供了精确的信息论公式。该模型提供了一个基于认知过程的ERP成分信息论模型,使我们更接近完全形式化的语言处理神经计算模型。
英文摘要:
The functional interpretation of language-related ERP components has been a central debate in psycholinguistics for decades. We advance an information-theoretic model of human language processing in the brain in which incoming linguistic input is processed at first shallowly and later with more depth, with these two kinds of information processing corresponding to distinct electroencephalographic signatures. Formally, we show that the information content (surprisal) of a word in context can be decomposed into two quantities: (A) shallow surprisal, which signals shallow processing difficulty for a word, and corresponds with the N400 signal; and (B) deep surprisal, which reflects the discrepancy between shallow and deep representations, and corresponds to the P600 signal and other late positivities. Both of these quantities can be estimated straightforwardly using modern NLP models. We validate our theory by successfully simulating ERP patterns elicited by a variety of linguistic manipulations in previously-reported experimental data from six experiments, with successful novel qualitative and quantitative predictions. Our theory is compatible with traditional cognitive theories assuming a `good-enough' shallow representation stage, but with a precise information-theoretic formulation. The model provides an information-theoretic model of ERP components grounded on cognitive processes, and brings us closer to a fully-specified neuro-computational model of language processing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。