大型语言模型的文化偏见与文化对齐
Cultural Bias and Cultural Alignment of Large Language Models
AI总结:
本研究评估了五个大型语言模型的文化偏见,发现其价值观偏向英语和新教欧洲国家,并提出文化提示策略,对较新模型在71-81%的国家和地区改善文化对齐。
摘要:
文化从根本上塑造了人们的推理、行为和沟通方式。随着人们越来越多地使用生成式人工智能(AI)来加速和自动化个人及专业任务,AI模型中嵌入的文化价值观可能会使人们真实的表达产生偏差,并导致某些文化占据主导地位。我们通过将五个广泛使用的大型语言模型(OpenAI的GPT-4o/4-turbo/4/3.5-turbo/3)的响应与具有全国代表性的调查数据进行比较,对这些模型的文化偏见进行了分类评估。所有模型表现出的文化价值观都类似于英语国家和新教欧洲国家。我们测试了文化提示作为控制策略,以增强每个国家/地区的文化对齐。对于较新的模型(GPT-4、4-turbo、4o),这一方法在71-81%的国家和地区中改善了模型输出的文化对齐。我们建议使用文化提示和持续评估来减少生成式AI输出中的文化偏见。
英文摘要:
Culture fundamentally shapes people's reasoning, behavior, and communication. As people increasingly use generative artificial intelligence (AI) to expedite and automate personal and professional tasks, cultural values embedded in AI models may bias people's authentic expression and contribute to the dominance of certain cultures. We conduct a disaggregated evaluation of cultural bias for five widely used large language models (OpenAI's GPT-4o/4-turbo/4/3.5-turbo/3) by comparing the models' responses to nationally representative survey data. All models exhibit cultural values resembling English-speaking and Protestant European countries. We test cultural prompting as a control strategy to increase cultural alignment for each country/territory. For recent models (GPT-4, 4-turbo, 4o), this improves the cultural alignment of the models' output for 71-81% of countries and territories. We suggest using cultural prompting and ongoing evaluation to reduce cultural bias in the output of generative AI.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。