Large Language Models (LLMs) encode vast world knowledge across multiple languages, yet their internal beliefs are often unevenly distributed across linguistic spaces. When external evidence contradicts these language-dependent memories, models encounter \emph{cross-lingual knowledge conflict}, a phenomenon largely unexplored beyond English-centric settings. We introduce \textbf{CLEAR}, a \textbf{C}ross-\textbf{L}ingual knowl\textbf{E}dge conflict ev\textbf{A}luation f\textbf{R}amework that systematically examines how multilingual LLMs reconcile conflicting internal beliefs and multilingual external evidence. CLEAR decomposes conflict resolution into four progressive scenarios, from multilingual parametric elicitation to competitive multi-source cross-lingual induction, and systematically evaluates model behavior across two complementary QA benchmarks with distinct task characteristics. We construct multilingual versions of ConflictQA and ConflictingQA covering 10 typologically diverse languages and evaluate six representative LLMs. Our experiments reveal a task-dependent decision dichotomy. In reasoning-intensive tasks, conflict resolution is dominated by language resource abundance, with high-resource languages exerting stronger persuasive power. In contrast, for entity-centric factual conflicts, linguistic affinity, not resource scale, becomes decisive, allowing low-resource but linguistically aligned languages to outperform distant high-resource ones.
GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models
University of Helsinki(赫尔辛基大学);Technical University of Darmstadt(达姆施塔特技术大学);University of Munich(慕尼黑大学);Nanjing University(南京大学);ELLIS Institute Finland(芬兰ELLIS研究所);University of Turku(图尔库大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Tailored untruths: How personalisation challenges LLM safeguards
University of Sheffield(谢菲尔德大学);University of Copenhagen(哥本哈根大学);Big Data for Smart Society Institute (GATE)(大数据智能社会研究所(GATE));University of São Paulo(圣保罗大学)
Is GPT-OSS Good? A Comprehensive Evaluation of OpenAI's Latest Open Source Models
AI Agent Lab, Vokram Group(AI代理实验室,Vokram集团);Purdue University(普渡大学);Georgia Institute of Technology(佐治亚理工学院);University of Minnesota(明尼苏达大学);Emory University(埃默里大学);Imperial College London(伦敦帝国学院)
FFE-Hallu:Hallucinations in Fixed Figurative Expressions:Benchmark of Idioms and Proverbs in the Persian Language
Tehran Institute for Advanced Studies, Khatam University, Iran(德黑兰高级研究 institute,Khatam 大学,伊朗);School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran(电气与计算机工程学院,工程学院,德黑兰大学,德黑兰,伊朗)
Multilingual Word Embeddings for Low-Resource Languages using Anchors and a Chain of Related Languages
Center for Information and Language Processing, LMU Munich(慕尼黑大学信息与语言处理中心);Munich Center for Machine Learning(慕尼黑机器学习中心);Technical University of Munich(慕尼黑工业大学)
XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triad
Department of Computer Science, National Centre for Text Mining, The University of Manchester(计算机科学系,国家文本挖掘中心,曼彻斯特大学);ELLIS Manchester(曼彻斯特ELLIS);School of Computing, Queen’s University, Ontario, Canada(计算学院,加拿大皇后大学);Computer Science, University of Illinois Chicago(计算机科学,伊利诺伊大学芝加哥分校);ELLIS Institute Finland(芬兰ELLIS研究所);University of Turku(图尔库大学);Department of Computer Science and Artificial Intelligence, Umm Al-Qura University, Makkah, Saudi Arabia(计算机科学与人工智能系,乌姆·阿勒·卡拉大学,麦加,沙特阿拉伯)
Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability
Google DeepMind(谷歌DeepMind);University of Alabama in Huntsville(阿拉巴马大学亨茨维尔分校);Google(谷歌);University of Missouri Columbia(密苏里大学哥伦比亚分校);Chunghwa Telecom Laboratories(春木电信实验室);University of Southern California(南加州大学);Polytechnique Montreal(蒙特利尔理工学院);Nutanix;ThinkEvolve Labs(ThinkEvolve实验室);UCL(伦敦大学学院);Infocomm Media Development Authority(信息通信媒体发展局);Monark Health(Monark健康);Seoul National University(首尔国立大学);Microsoft(微软);Centre for Responsible AI (CeRAI), Wadhwani School of Data Science and AI (WSAI), Indian Institute of Technology Madras(负责任人工智能中心(CeRAI)、瓦达威人工智能学校(WSAI)、印度理工学院马德拉斯分校);University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校);Microsoft Research India(微软印度研究院);Stanford University(斯坦福大学);Argonne National Laboratory(阿贡国家实验室);University of Oxford(牛津大学);KAIST(韩国科学技术院);Yonsei University(延世大学);Amazon(亚马逊);UIUC(伊利诺伊大学香槟分校);Rochester Institute of Technology(罗切斯特理工学院);Xenoscube Inc.(Xenoscube公司);Korea AI Safety Institute (K-AISI)(韩国人工智能安全研究所(K-AISI));MLCommons;CommonGround;Artifex Labs(Artifex实验室)
Viveka-Insight: a cross-lingual concept graph and citation-grounded retrieval resource over the complete works of Swami Vivekananda in English and Bengali
Ramakrishna Mission Vivekananda Educational and Research Institute(罗摩克里希那传教会维韦卡南达教育与研究学院)