Large language models have become the latest trend in natural language processing, heavily featuring in the digital tools we use every day. However, their replies often reflect a narrow cultural viewpoint that overlooks the diversity of global users. This missing capability could be referred to as cultural reasoning, which we define here as the capacity of a model to recognise culture-specific knowledge values and social norms, and to adjust its output so that it aligns with the expectations of individual users. Because culture shapes interpretation, emotional resonance, and acceptable behaviour, cultural reasoning is essential for identity-aware AI. When this capacity is limited or absent, models can sustain stereotypes, ignore minority perspectives, erode trust, and perpetuate hate. Recent empirical studies strongly suggest that current models default to Western norms when judging moral dilemmas, interpreting idioms, or offering advice, and that fine-tuning on survey data only partly reduces this tendency. The present evaluation methods mainly report static accuracy scores and thus fail to capture adaptive reasoning in context. Although broader datasets can help, they cannot alone ensure genuine cultural competence. Therefore, we argue that cultural reasoning must be treated as a foundational capability alongside factual accuracy and linguistic coherence. By clarifying the concept and outlining initial directions for its assessment, a foundation is laid for future systems to be able to respond with greater sensitivity to the complex fabric of human culture.
CulMind: Benchmarking Multimodal Understanding and Reasoning in Chinese Cultural Heritage
University of International Relations(国际关系学院);Kedge Business School(凯致商学院);Peking University(北京大学);Tsinghua University(清华大学);Beijing University of Posts and Telecommunications(北京邮电大学);Capital Normal University(首都师范大学)
Mohamed bin Zayed University of Artificial Intelligence(莫扎伊德·本·泽德人工智能大学);SDAIA;Al-Balqa Applied University(巴尔加应用大学);Khalifa University(卡利法大学);HUMAIN, Data and AI Models(HUMAIN、数据与人工智能模型)
XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triad
Department of Computer Science, National Centre for Text Mining, The University of Manchester(计算机科学系,国家文本挖掘中心,曼彻斯特大学);ELLIS Manchester(曼彻斯特ELLIS);School of Computing, Queen’s University, Ontario, Canada(计算学院,加拿大皇后大学);Computer Science, University of Illinois Chicago(计算机科学,伊利诺伊大学芝加哥分校);ELLIS Institute Finland(芬兰ELLIS研究所);University of Turku(图尔库大学);Department of Computer Science and Artificial Intelligence, Umm Al-Qura University, Makkah, Saudi Arabia(计算机科学与人工智能系,乌姆·阿勒·卡拉大学,麦加,沙特阿拉伯)
LLMs as Cultural Archives: Cultural Commonsense Knowledge Graph Extraction
Mohamed bin Zayed University of Artificial Intelligence(莫扎德·本·扎耶德人工智能大学);Ubiquitous Knowledge Processing Lab (UKP Lab)(无处不在知识处理实验室);Department of Computer Science(计算机科学系);Hessian Center for AI (hessian.AI)(黑森人工智能中心);Technische Universität Darmstadt(德累斯顿技术大学)
SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
Nanyang Technological University(南洋理工大学);Institute for Infocomm Research (IR), A*STAR(新加坡科技研究局信息通信研究所);Centre for Frontier AI Research (CFAR), A*STAR(新加坡科技研究局前沿人工智能研究中心)
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning
School of Computer Science and Technology, Wuhan University of Science and Technology(武汉科技大学计算机科学与技术学院);Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology(湖北省智能信息处理与实时工业系统重点实验室);Innovation, Policy and Entrepreneurship Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)创新、政策与创业方向);Tübingen AI Center, University of Tübingen(图宾根大学图宾根人工智能中心);Department of Computer Science, University of Copenhagen(哥本哈根大学计算机科学系)
CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understanding
Instituto Politécnico Nacional(墨西哥国立理工学院);Haverford College(哈弗福德学院);Wollo University(沃尔洛大学);Pennsylvania State University(宾夕法尼亚州立大学);University of Hamburg(汉堡大学)
HalluScore: Large Language Model Hallucination Question Answering Benchmark
Department of Information and Computer Science, King Fahd University of Petroleum and Minerals(国王法赫德石油与矿物大学信息与计算机科学系);SDAIA-KFUPM Joint Research Center for Artificial Intelligence(SDAIA-KFUPM人工智能联合研究中心)
BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interaction
Jahangirnagar University(贾亨吉尔纳加尔大学);Rajshahi University of Engineering & Technology(拉贾沙希工程与技术大学);Bangladesh University of Engineering and Technology(孟加拉工程与技术大学)
An Investigation into Value Misalignment in LLM-Generated Texts for Cultural Heritage
Department of Archeology and Museology, Shanghai University(考古与博物馆学系,上海大学);National Collaborative Research Center for Revolutionary Cultural Heritage at Memorial of the First CPC National Congress & Shanghai University(革命文化遗产国家联合研究中心,中共一大会址纪念馆与上海大学);School of Management, Shanghai University(管理学院,上海大学);Nanyang Technological University(南洋理工大学)
Evaluating and Improving Cultural Awareness of Reward Models for LLM Alignment
Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China(计算与智能研究所,哈尔滨工业大学,深圳,中国);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室,深圳,中国)