Improving the alignment of Large Language Models (LLMs) with respect to the cultural values that they encode has become an increasingly important topic. In this work, we study whether we can exploit existing knowledge about cultural values at inference time to adjust model responses to cultural value probes. We present a simple and inexpensive method that uses a combination of in-context learning (ICL) and human survey data, and show that we can improve the alignment to cultural values across 5 models that include both English-centric and multilingual LLMs. Importantly, we show that our method could prove useful in test languages other than English and can improve alignment to the cultural values that correspond to a range of culturally diverse countries.
Whispers of Many Shores: Cultural Alignment through Collaborative Cultural Expertise
Arizona State University(亚利桑那州立大学);National Taiwan University(台湾国立大学);Carnegie Mellon University(卡内基梅隆大学);New York University(纽约大学);Indian Institute of Technology Hyderabad(印度海得拉巴理工学院);Minitab(Minitab公司);Trinity College Dublin(都柏林圣三一学院)
ALIGN: Word Association Learning for Cultural Alignment in Large Language Models
School of Computing and Information Systems, The University of Melbourne(计算与信息系统学院,墨尔本大学);Melbourne Data Analytics Platform, The University of Melbourne(墨尔本数据分析平台,墨尔本大学);Faculty of Information Technology, Monash University(信息技术学院,墨尔本大学)
Evaluating and Improving Cultural Awareness of Reward Models for LLM Alignment
Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China(计算与智能研究所,哈尔滨工业大学,深圳,中国);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室,深圳,中国)
BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interaction
Jahangirnagar University(贾亨吉尔纳加尔大学);Rajshahi University of Engineering & Technology(拉贾沙希工程与技术大学);Bangladesh University of Engineering and Technology(孟加拉工程与技术大学)
Cross-cultural value alignment frameworks for responsible AI governance: Evidence from China-West comparative analysis
Wuhan University of Science and Technology(武汉理工大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));University of Copenhagen(哥本哈根大学);WUST-Madrid Complutense Institute(武汉理工大学-马德里康普顿斯研究所)
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
Department of Computer Science, National Center for Text Mining, The University of Manchester(计算机科学系,文本挖掘国家中心,曼彻斯特大学);Department of Computer Science and Engineering, Islamic University of Technology(计算机科学与工程系,伊斯兰技术大学)
Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs
Graduate School of Data Science, Dept. of Data Science, Seoul National University(数据科学研究生院、数据科学系、首尔国立大学);College of Engineering, Dept. of Computer Science and Engineering, Seoul National University(工程学院、计算机科学与工程系、首尔国立大学)
Prompt Programming for Cultural Bias and Alignment of Large Language Models
Information Systems and Modeling, Los Alamos National Laboratory(信息系统与建模,洛斯阿拉莫斯国家实验室);Advanced Research in Cyber Systems, Los Alamos National Laboratory(网络安全系统高级研究,洛斯阿拉莫斯国家实验室);Center for National Security and International Studies(国家安全与国际研究中心);Analytics Division, Los Alamos National Laboratory(分析部门,洛斯阿拉莫斯国家实验室)
DIWALI: Diversity and Inclusivity aWare cuLture specific Items for India: Dataset and Assessment of LLMs for Cultural Text Adaptation in Indian Context
Natural Language and Information Processing Lab (NLIP) Indian Institute of Technology Hyderabad(自然语言与信息处理实验室(NLIP)印度理工学院海得拉巴)
Training-Free Cultural Alignment of Large Language Models via Persona Disagreement
Faculty of Information and Technology, University of Science, Vietnam National University(信息与技术学院,科学大学,越南国家大学);Department of Computer Science, University of Warwick(计算机科学系,沃里克大学);School of Computing, Engineering and Digital Technologies, Teesside University(计算、工程和数字技术学院,泰赛德大学)
C-VARC: A Large-Scale Chinese Value Rule Corpus for Value Alignment of Large Language Models
BrainCog Lab, Institute of Automation, Chinese Academy of Sciences, Beijing, China(中国科学院自动化研究所脑认知实验室,北京,中国);Beijing Key Laboratory of Safe AI and Superalignment, Beijing, China(北京安全人工智能与超对齐关键实验室,北京,中国);Beijing Institute of AI Safety and Governance, Beijing, China(北京人工智能安全与治理研究所,北京,中国);The School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学人工智能学院,北京,中国);Long-term AI, Beijing, China(长期人工智能,北京,中国)
MCEval: A Dynamic Framework for Fair Multilingual Cultural Evaluation of LLMs
Zhejiang University(浙江大学);School of Engineering, Westlake University(西溪大学工程学院);Southern University of Science and Technology(南方科技大学);Institute of Advanced Technology, Westlake Institute for Advanced Study(西溪研究院先进技术研究所)