arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2603.16827cs.AIcs.CL

提示编程用于大型语言模型的文化偏差与对齐

Prompt Programming for Cultural Bias and Alignment of Large Language Models

Information Systems and Modeling, Los Alamos National Laboratory(信息系统与建模,洛斯阿拉莫斯国家实验室);Advanced Research in Cyber Systems, Los Alamos National Laboratory(网络安全系统高级研究,洛斯阿拉莫斯国家实验室);Center for National Security and International Studies(国家安全与国际研究中心);Analytics Division, Los Alamos National Laboratory(分析部门,洛斯阿拉莫斯国家实验室)

Maksim Eren, Eric Michalak, Brian Cook, Johnny Seales

AI总结:

本文提出通过提示编程优化大型语言模型的文化对齐,利用DSPy框架系统调整治文化偏差,实验表明提示优化优于传统手动提示工程,提升模型响应的可转移性与稳定性。

摘要:

文化塑造了推理、价值观、优先级和战略决策,但大型语言模型(LLMs)常表现出文化偏见,与目标人群不一致。随着LLMs在战略决策、政策支持和文档工程任务中的广泛应用,提高文化对齐性对确保下游分析和建议反映目标人群的价值观至关重要。本文扩展了先前基于调查的文化对齐框架,通过在开源LLMs上复现社会科学研究的投影和距离度量,验证了文化偏差和文化条件化在非闭源LLMs中的持续性。基于此,本文引入提示编程(使用DSPy)将提示视为模块化、可优化的程序,系统地调整治文化偏差,通过优化文化距离目标提升模型响应的对齐性。实验表明,提示优化通常优于传统手动提示工程,提示编译与DSPy可提供更稳定和可转移的文化对齐路径。

英文摘要:

Culture shapes reasoning, values, prioritization, and strategic decision-making, yet large language models (LLMs) often exhibit cultural biases that misalign with target populations. As LLMs are increasingly used for strategic decision-making, policy support, and document engineering tasks such as summarization, categorization, and compliance-oriented auditing, improving cultural alignment is important for ensuring that downstream analyses and recommendations reflect target-population value profiles rather than default model priors. Previous work introduced a survey-grounded cultural alignment framework and showed that culture-specific prompting can reduce misalignment, but it primarily evaluated proprietary models and relied on manual prompt engineering. In this paper, we validate and extend that framework by reproducing its social sciences survey based projection and distance metrics on open-weight LLMs, testing whether the same cultural skew and benefits of culture conditioning persist outside closed LLM systems. Building on this foundation, we introduce use of prompt programming with DSPy for this problem-treating prompts as modular, optimizable programs-to systematically tune cultural conditioning by optimizing against cultural-distance objectives. In our experiments, we show that prompt optimization often improves upon cultural prompt engineering, suggesting prompt compilation with DSPy can provide a more stable and transferable route to culturally aligned LLM responses.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑