发表机构
University of Aberdeen; University of Birmingham; University College London（阿伯丁大学; 伯明翰大学; 伦敦大学学院）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本文通过格构式相关的受控实验，证实语言模型易受结构启动影响，该启动跨语言表征多层面运作，受词汇-语义连贯性增强，且双宾语格构式相对增幅更大、介词宾语格构式绝对增幅更大。
AI 中文摘要
本文研究语言模型（LM）生成中的结构启动，考察前文的结构语境如何影响句子补全。此前研究已证明结构交替理解中存在启动效应，但LM生成时每一步会从众多可能的后续内容中采样，该效应是否在生成中持续存在尚不明确。我们通过与格构式相关的一系列受控句子补全实验解决此问题。与此前研究一致，我们发现LM易受结构启动影响，尤其在语义连贯的句子中。关于启动幅度，我们发现，与基线相比，双宾语格构式的相对增幅更大，符合逆频率效应；而更常被生成的介词宾语格构式的绝对增幅更大。最后，我们不仅观察到词汇-语义连贯性会增强结构启动，还发现经结构启动的补全表现出更高水平的词汇-语义重复。综上，我们的证据支持LM中的结构启动跨多个语言表征层面运作，由句法、词汇和语义对齐促进并受其促进。代码：this https URL。
英文摘要
This paper investigates structural priming in language model (LM) production, examining how preceding structural context influences sentence completion. While prior work has demonstrated priming effects in comprehension of structural alternations, it remained unclear whether these persist in production, where, when generating, an LM samples from many possible continuations at each step. We address this question through a series of controlled sentence-completion experiments on dative constructions. In line with prior work, we find that LMs are susceptible to structural priming, particularly in sentences that are semantically coherent. In terms of priming magnitude, we find that while there is a greater relative increase of double-object datives against our baselines, in line with inverse frequency effects, there is a larger absolute increase in prepositional-objects, the more frequently produced construction. Finally, we not only observe that structural priming is boosted by lexico-semantic coherence, but that structurally primed completions display greater levels of lexico-semantic repetition. Taken together, our evidence supports the view that structural priming in LMs operates across multiple levels of linguistic representation, facilitating, and facilitated by syntactic, lexical, and semantic alignment. Code: https://github.com/the-context-lab/primedproduction.
CommentsEMNLP 2026 Findings
