arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2508.19269cs.CYcs.AIcs.CL

大语言模型是否应该WEIRD?探索大语言模型中的WEIRD性与人权

Should LLMs be WEIRD? Exploring WEIRDness and Human Rights in Large Language Models

Nokia Bell Labs(诺基亚贝尔实验室)

Ke Zhou, Marios Constantinides, Daniele Quercia

AI总结:

本文通过世界价值观调查评估五个主流大语言模型,发现与WEIRD价值观一致性较低的模型虽文化多样性更高,但违反人权的输出风险增加2%至4%,揭示文化代表性与人权保障之间的张力。

摘要:

大语言模型(LLMs)通常在反映WEIRD价值观的数据上进行训练:西方的(Western)、受过教育的(Educated)、工业化的(Industrialized)、富裕的(Rich)和民主的(Democratic)。这引发了对文化偏见和公平性的担忧。利用世界价值观调查(World Values Survey)的回应,我们评估了五个广泛使用的LLMs:GPT-3.5、GPT-4、Llama-3、BLOOM和Qwen。我们测量了这些回应与WEIRD国家价值观的一致程度,以及它们是否与人权原则相冲突。为了反映全球多样性,我们将结果与《世界人权宣言》(Universal Declaration of Human Rights)以及来自亚洲、中东和非洲的三个区域性宪章进行了比较。与WEIRD价值观一致性较低的模型,如BLOOM和Qwen,产生了更多文化上多样化的回应,但生成违反人权输出的可能性高出2%至4%,尤其是在性别和平等方面。例如,一些模型同意“不能生育孩子的男人不是真正的男人”和“丈夫应该始终知道妻子在哪里”这样的陈述,反映了有害的性别规范。这些发现表明,随着LLMs中文化代表性的增加,复制歧视性信念的风险也随之增加。诸如宪法人工智能(Constitutional AI)之类的方法,可以将人权原则嵌入模型行为中,可能只能部分帮助解决这一张力。

英文摘要:

Large language models (LLMs) are often trained on data that reflect WEIRD values: Western, Educated, Industrialized, Rich, and Democratic. This raises concerns about cultural bias and fairness. Using responses to the World Values Survey, we evaluated five widely used LLMs: GPT-3.5, GPT-4, Llama-3, BLOOM, and Qwen. We measured how closely these responses aligned with the values of the WEIRD countries and whether they conflicted with human rights principles. To reflect global diversity, we compared the results with the Universal Declaration of Human Rights and three regional charters from Asia, the Middle East, and Africa. Models with lower alignment to WEIRD values, such as BLOOM and Qwen, produced more culturally varied responses but were 2% to 4% more likely to generate outputs that violated human rights, especially regarding gender and equality. For example, some models agreed with the statements ``a man who cannot father children is not a real man'' and ``a husband should always know where his wife is'', reflecting harmful gender norms. These findings suggest that as cultural representation in LLMs increases, so does the risk of reproducing discriminatory beliefs. Approaches such as Constitutional AI, which could embed human rights principles into model behavior, may only partly help resolve this tension.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑