双语模型中的跨语言迁移是否具有人类特性?一项以荷兰语和英语重叠词形研究
Is Cross-Lingual Transfer in Bilingual Models Human-Like? A Study with Overlapping Word Forms in Dutch and English
AI总结:
研究探讨双语模型中跨语言激活是否模仿人类处理模式,发现词形共享影响模型表现,频率而非形式一致性主导效果,仅在特定条件下重现人类处理特征。
摘要:
双语说话人在阅读时表现出跨语言激活,尤其对于具有共享表层形式的词。同源词通常促进处理,而跨语言同形词(假朋友)导致干扰或无效应。本文研究双语语言模型中的跨语言激活是否遵循这些模式。我们训练了荷兰语-英语因果Transformer,在四种词汇共享条件下操纵(假)朋友是否获得共享或语言特定的嵌入。使用双语阅读研究中的心理语言学刺激,通过惊奇度和嵌入相似性分析评估模型。模型基本维持语言分离,当嵌入共享时跨语言效应出现。在这些情况下,同源词和假朋友相对于对照组均显示促进效应。回归分析显示这些效应主要由频率而非形式-意义映射的一致性驱动。只有当仅同源词共享嵌入时,才能重现双语者的定性模式。总体而言,双语语言模型捕捉了一些跨语言激活效应。然而,其与人类处理的对齐可能严重依赖于词形重叠的编码方式,这可能限制了其作为双语阅读模型的解释充分性。
英文摘要:
Bilingual speakers show cross-lingual activation during reading, especially for words with shared surface form. Cognates (friends) typically lead to facilitation, whereas interlingual homographs (false friends) cause interference or no effect. We examine whether cross-lingual activation in bilingual language models mirrors these patterns. We train Dutch-English causal Transformers under four vocabulary-sharing conditions that manipulate whether (false) friends receive shared or language-specific embeddings. Using psycholinguistic stimuli from bilingual reading studies, we evaluate the models through surprisal and embedding similarity analyses. The models largely maintain language separation, and cross-lingual effects arise primarily when embeddings are shared. In these cases, both friends and false friends show facilitation relative to controls. Regression analyses reveal that these effects are mainly driven by frequency rather than consistency in form-meaning mapping. Only when just friends share embeddings are the qualitative patterns of bilinguals reproduced. Overall, bilingual language models capture some cross-linguistic activation effects. However, their alignment with human processing seems to critically depend on how lexical overlap is encoded, possibly limiting their explanatory adequacy as models of bilingual reading.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。