arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.07041cs.CL
收藏

当丰裕掩盖弱点:多语言模型中的知识冲突

When Abundance Conceals Weakness: Knowledge Conflict in Multilingual Models

Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Hangzhou Dianzi University(杭州电子科技大学)

Jiaqi Zhao, Qiang Huang, Haodong Chen, Xiaoxing You, Jun Yu

AI总结:

研究提出CLEAR框架,分析多语言模型在跨语言知识冲突中的解决机制,揭示任务类型对冲突解决的影响,显示语言资源丰富度与语言亲和力在不同任务中的决定性作用。

摘要:

大型语言模型(LLMs)在多种语言中编码了广泛的世界知识,但其内部信念往往在语言空间中分布不均。当外部证据与这些语言依赖的记忆矛盾时,模型会遇到跨语言知识冲突,这种现象在非英语中心设置中鲜有探索。我们引入CLEAR,一种跨语言知识冲突评估框架,系统地检验多语言LLM如何解决冲突的内部信念和多语言外部证据。CLEAR将冲突解决分解为四个渐进场景,从多语言参数提取到竞争性多源跨语言归纳,并系统地在两个互补的问答基准上评估模型行为。我们构建了覆盖10种类型多样语言的多语言ConflictQA和ConflictingQA,并评估了六个代表性的LLM。我们的实验揭示了任务依赖的决策二元性。在推理密集型任务中,冲突解决主要由语言资源丰富度决定,高资源语言具有更强的说服力。相反,在以实体为中心的事实冲突中,语言亲和力而非资源规模成为决定性因素,使低资源但语言上一致的语言优于远距离的高资源语言。

英文摘要:

Large Language Models (LLMs) encode vast world knowledge across multiple languages, yet their internal beliefs are often unevenly distributed across linguistic spaces. When external evidence contradicts these language-dependent memories, models encounter \emph{cross-lingual knowledge conflict}, a phenomenon largely unexplored beyond English-centric settings. We introduce \textbf{CLEAR}, a \textbf{C}ross-\textbf{L}ingual knowl\textbf{E}dge conflict ev\textbf{A}luation f\textbf{R}amework that systematically examines how multilingual LLMs reconcile conflicting internal beliefs and multilingual external evidence. CLEAR decomposes conflict resolution into four progressive scenarios, from multilingual parametric elicitation to competitive multi-source cross-lingual induction, and systematically evaluates model behavior across two complementary QA benchmarks with distinct task characteristics. We construct multilingual versions of ConflictQA and ConflictingQA covering 10 typologically diverse languages and evaluate six representative LLMs. Our experiments reveal a task-dependent decision dichotomy. In reasoning-intensive tasks, conflict resolution is dominated by language resource abundance, with high-resource languages exerting stronger persuasive power. In contrast, for entity-centric factual conflicts, linguistic affinity, not resource scale, becomes decisive, allowing low-resource but linguistically aligned languages to outperform distant high-resource ones.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑