arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.08034cs.CLcs.AIcs.CY
收藏

PLURAL:一个用于价值对齐的全球数据集

PLURAL: A Global Dataset for Value Alignment

Dhruv Agarwal, Anya Shukla, Tanya Goyal, Aditya Vashistha

AI总结:

研究针对大语言模型反映西方价值观问题,引入基于IVS的PLURAL数据集,通过两阶段管道生成偏好三元组,经三种方式评估,结果显示其含价值引导可学习信号,能为多元对齐提供资源。

摘要:

大语言模型在全球广泛使用,但过度反映西方价值观,限制了其代表多样价值体系的能力。我们引入了PLURAL,这是一个基于涵盖92个国家的具有全国代表性的综合价值观调查(IVS)的大规模、以价值为重点的偏好数据集。通过两阶段生成管道,将调查回复转化为合成偏好三元组,保留规范价值信号并生成现实场景。我们发布了PLURAL的初始版本,包含约50万个代表20个不同国家人群的偏好三元组。通过三种方式评估PLURAL:数据集级验证表明它保留了原始调查中的国家间价值差异和国家内部多样性;自动评估表明在PLURAL上训练可提高与目标国家文化概况的对齐度,相对于强大基线,平均绝对误差最多降低27.7%;由印度、巴西和日本的176名评估人员进行的盲法人工评估,他们认为与PLURAL对齐的回复更能代表其国家价值观。这些结果表明PLURAL包含可用于价值引导的可学习信号,为多元对齐提供了可扩展资源。

英文摘要:

Large language models (LLMs) are used worldwide, yet disproportionately reflect Western values, limiting their ability to represent diverse value systems. We introduce PLURAL, a large-scale, value-focused preference dataset grounded in the Integrated Values Survey (IVS), a nationally representative survey spanning 92 countries. Using a two-stage generation pipeline, we transform survey responses into synthetic preference triplets that preserve normative value signals while producing realistic scenarios. We release an initial version of PLURAL containing ~500,000 preference triplets representing people in 20 diverse countries. We evaluate PLURAL in three ways: (i) dataset-level validation showing that it preserves both cross-country value differences and within-country diversity from the original survey; (ii) automated evaluation showing that training on PLURAL improves alignment with target countries' cultural profiles, reducing mean absolute error by up to 27.7% relative to strong baselines; and (iii) blind human evaluation with 176 evaluators in India, Brazil, and Japan, who judge PLURAL-aligned responses as more representative of their national values. Together, these results show that PLURAL contains learnable signal for value steering, offering a scalable resource for pluralistic alignment. Dataset: https://huggingface.co/datasets/agdhruv/plural-alignment

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑