AI 中文总结
研究Transformer语言模型实现何种心理空间构建机制，发现其采用共享路由器和值槽格式，一种空间类型子空间训练能控制其他类型，确立跨类型通用性，还表明该机制驱动推理和组合。
AI 中文摘要
语言构建除实际情况之外的话语语境，如绘画、信念、记忆、假设等，每个都是心理空间，同一实体在其中可具不同值。形式语义学因逻辑差异将这些语境分开，而福柯尼耶的心理空间理论将其视为一种空间构建操作。本文探究Transformer语言模型实现了哪种，发现了福柯尼耶统一的一种机制版本。模型在整个库存中使用一种路由器/槽格式，一个可重复使用的值槽存储属性内容，一个可因果操纵的路由器（空间索引）选择读取哪个空间。用分布式对齐搜索训练的子空间控制一种空间类型（反事实、信念、虚构或时间）时，也能控制其他类型，在三个模型系列上远超随机水平，信念未被特别区分。路由器是低秩的，与实体身份相加组合，并通过几个后期层头部起作用。另外两个结果表明该机制驱动推理和组合，本文确立了跨类型通用性。
英文摘要
Language builds discourse contexts other than the actual: a painting, a belief, a memory, a hypothetical. Each is a mental space in which the same entity can take a different value, as when a flower is red in reality but purple in a portrait. Formal semantics keeps these contexts apart because their logics differ (modal, temporal, doxastic, depictive). Fauconnier's mental-space theory, by contrast, treats them as one space-building operation. We ask which of these a transformer language model implements, and find a mechanistic version of Fauconnier's unification. The model uses one router/slot format across the inventory: a reusable value slot stores attributed content, and a causally manipulable router (the space index) selects which space is read. A subspace trained with Distributed Alignment Search to control one space type, counterfactual, belief, fictional, or temporal, also controls the others, well above a random floor, on three model families. Belief, which formal semantics marks as a distinct case, is not specially separated. The router is low-rank, composes additively with entity identity, and acts through a few late-layer heads. Two further results show the mechanism drives inference and composes: a subspace trained on a rule-derived conclusion flips what the model infers while dissociating from what it reports, and composing space-builders mints a fresh router over the shared slot. This paper establishes the cross-type generality. A companion paper develops belief in depth, because of its special status in philosophy, psychology, and linguistics (epistemology, theory of mind, and propositional attitude reports).
Comments26 pages, 5 figures, 9 tables. v2: cite the released Mental Spaces Corpus (dataset DOI); switch to ACL bibliography style; minor copy-editing. No change to results
