价值万花筒:让AI与多元人类价值、权利与义务相契合
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties
AI总结:
本文提出ValuePrism数据集和Kaleido多任务模型,用于在具体情境中生成、解释和评估多元人类价值、权利与义务,从而帮助AI系统更显式地建模价值冲突并做出更符合人类价值的决策。
摘要:
人类价值对人类决策至关重要。价值多元主义认为,多个正确的价值可能彼此处于张力之中(例如,当考虑对朋友撒谎以保护其感受时,如何在诚实与友谊之间取得平衡?)。作为统计学习者,AI系统默认拟合平均值,从而抹平了这些可能不可化约的价值冲突。为了使AI系统更好地反映价值多元主义,首要挑战是探索AI系统能够在多大程度上对多元人类价值、权利与义务及其相互作用进行建模。我们引入了ValuePrism,这是一个大规模数据集,包含218k条价值、权利与义务,并与31k个人类书写的情境相连接。ValuePrism的情境化价值由GPT-4生成,并在91%的情况下被人类标注者判定为高质量。我们开展了一项大规模研究,邀请来自不同社会与人口背景的标注者参与,以尝试理解哪些人的价值得到了体现。基于ValuePrism,我们构建了Kaleido,这是一个开放、轻量且结构化的基于语言的多任务模型,能够在特定情境中生成、解释并评估人类价值、权利与义务的相关性和效价(即支持或反对)。与教师模型GPT-4相比,人类更偏好我们系统输出的价值集合,认为其更准确且覆盖范围更广。此外,我们证明了Kaleido能够通过输出相互对立的价值来帮助解释人类决策中的变异性。最后,我们表明Kaleido的表示可以迁移到其他哲学框架和数据集,证实了以显式、模块化和可解释的方式处理价值多元主义的益处。我们希望我们的工作能够成为使人类决策背后隐含的价值更加显式化的一步,并引导AI系统做出更符合这些价值的决策。
英文摘要:
Human values are crucial to human decision-making. Value pluralism is the view that multiple correct values may be held in tension with one another (e.g., when considering lying to a friend to protect their feelings, how does one balance honesty with friendship?). As statistical learners, AI systems fit to averages by default, washing out these potentially irreducible value conflicts. To improve AI systems to better reflect value pluralism, the first-order challenge is to explore the extent to which AI systems can model pluralistic human values, rights, and duties as well as their interaction. We introduce ValuePrism, a large-scale dataset of 218k values, rights, and duties connected to 31k human-written situations. ValuePrism's contextualized values are generated by GPT-4 and deemed high-quality by human annotators 91% of the time. We conduct a large-scale study with annotators across diverse social and demographic backgrounds to try to understand whose values are represented. With ValuePrism, we build Kaleido, an open, light-weight, and structured language-based multi-task model that generates, explains, and assesses the relevance and valence (i.e., support or oppose) of human values, rights, and duties within a specific context. Humans prefer the sets of values output by our system over the teacher GPT-4, finding them more accurate and with broader coverage. In addition, we demonstrate that Kaleido can help explain variability in human decision-making by outputting contrasting values. Finally, we show that Kaleido's representations transfer to other philosophical frameworks and datasets, confirming the benefit of an explicit, modular, and interpretable approach to value pluralism. We hope that our work will serve as a step to making more explicit the implicit values behind human decision-making and to steering AI systems to make decisions that are more in accordance with them.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。