arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.08205cs.CL
收藏

人类语言处理中EEG签名的统一信息论模型

A unified information-theoretic model of EEG signatures of human language processing

University of California Irvine(加州大学欧文分校)

Jiaxuan Li, Richard Futrell

摘要:

我们提出了一个信息理论模型的人类语言处理在大脑中,传入的语言输入处理在两个层面上,在一个启发式的解释和纠错方面。我们认为,这两种信息处理具有不同的脑电特征,对应于语言相关事件相关电位(ERPs)的N400和P600成分。形式上,我们表明,一个词在上下文中的信息内容(crossal)可以分解为两个量:(A)启发式的惊喜,这标志着处理困难的词给定其推断的上下文,并对应于N400信号;和(B)差异信号,这反映了真实的上下文和推断的上下文之间的分歧,并对应于P600信号。这两个量都可以使用现代NLP技术进行估计。我们通过成功模拟Ryskin等人(2021)先前报道的实验数据中各种语言操作引起的ERP模式来验证我们的理论。我们的理论是在原则上兼容传统的认知理论假设一个“足够好”的启发式解释阶段,但精确的信息理论制定。

英文摘要:

We advance an information-theoretic model of human language processing in the brain, in which incoming linguistic input is processed at two levels, in terms of a heuristic interpretation and in terms of error correction. We propose that these two kinds of information processing have distinct electroencephalographic signatures, corresponding to the well-documented N400 and P600 components of language-related event-related potentials (ERPs). Formally, we show that the information content (surprisal) of a word in context can be decomposed into two quantities: (A) heuristic surprise, which signals processing difficulty of word given its inferred context, and corresponds with the N400 signal; and (B) discrepancy signal, which reflects divergence between the true context and the inferred context, and corresponds to the P600 signal. Both of these quantities can be estimated using modern NLP techniques. We validate our theory by successfully simulating ERP patterns elicited by a variety of linguistic manipulations in previously-reported experimental data from Ryskin et al. (2021). Our theory is in principle compatible with traditional cognitive theories assuming a `good-enough' heuristic interpretation stage, but with precise information-theoretic formulation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑