arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.14728cs.CL
收藏

记忆编码中的策略性资源分配:塑造语言加工的效率原则

Strategic resource allocation in memory encoding: An efficiency principle shaping language processing

University of California, Irvine(加州大学尔湾分校)

Weijie Xu, Richard Futrell

AI总结:

本文提出策略性资源分配(SRA)原则,主张工作记忆优先高精度编码意外信息,并通过自然语料的产出与理解证据解释依存局部性效应及跨语言差异。

摘要:

工作记忆的有限容量如何被高效利用以支持人类的语言行为?本文提出策略性资源分配(Strategic Resource Allocation,SRA),将其作为句子加工中记忆编码的一项效率原则。其核心思想是,工作记忆资源得到动态且策略性的分配,以优先处理新颖和意外的信息。从资源理性的视角出发,我们认为 SRA 是由关于工作记忆的两个功能性假设所提出的计算问题的原则性解决方案,这两个假设即容量有限和表征有噪声。具体而言,工作记忆需要在记忆资源有限的约束下,最小化对过去输入的检索误差;这一优化问题的解,是将更多资源分配给以更高精度编码更令人意外的输入。SRA 的关键后果之一是,令人意外的输入会以增强的表征被编码,因此更不易受到记忆衰退和干扰的影响。在实证方面,通过自然语料库数据,我们在依存局部性的语境中,从产出和理解两方面发现了支持 SRA 的汇聚证据:先行词较不可预测的非局部依存与减弱的局部性效应相关。然而,我们的结果也揭示出相当大的跨语言变异性,这表明需要更细致地考察 SRA 作为一种领域一般性的记忆效率原则,如何与特定语言的短语结构相互作用。SRA 凸显了表征不确定性在理解记忆编码中的关键作用,并从高效记忆编码的视角重新构想了 surprisal(意外度)和 entropy(熵)对加工困难的影响。

英文摘要:

How is the limited capacity of working memory efficiently used to support human linguistic behaviors? In this paper, we propose Strategic Resource Allocation (SRA) as an efficiency principle for memory encoding in sentence processing. The idea is that working memory resources are dynamically and strategically allocated to prioritize novel and unexpected information. From a resource-rational perspective, we argue that SRA is the principled solution to a computational problem posed by two functional assumptions about working memory, namely its limited capacity and its noisy representation. Specifically, working memory needs to minimize the retrieval error of past inputs under the constraint of limited memory resources, an optimization problem whose solution is to allocate more resources to encode more surprising inputs with higher precision. One of the critical consequences of SRA is that surprising inputs are encoded with enhanced representations, and therefore are less susceptible to memory decay and interference. Empirically, through naturalistic corpus data, we find converging evidence for SRA in the context of dependency locality from both production and comprehension, where non-local dependencies with less predictable antecedents are associated with reduced locality effect. However, our results also reveal considerable cross-linguistic variability, suggesting the need for a closer examination of how SRA, as a domain-general memory efficiency principle, interacts with language-specific phrase structures. SRA highlights the critical role of representational uncertainty in understanding memory encoding. It also reimages the effects of surprisal and entropy on processing difficulty from the perspective of efficient memory encoding.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑