测量价值对齐
Measuring Value Alignment
AI总结：
本文提出一种基于马尔可夫决策过程的形式化框架，通过评估状态转换中的偏好变化来量化AI系统与人类价值观的对齐程度，以指导AI决策并确保其与人类价值观和谐运作。
摘要：
随着人工智能（AI）系统日益融入各个领域，确保它们与人类价值观保持一致变得至关重要。本文引入了一种新颖的形式化方法，以马尔可夫决策过程（MDPs）为基础模型，量化AI系统与人类价值观之间的对齐程度。我们深入探讨了价值观作为与行动相关联的理想目标以及规范作为行为指南的概念，旨在阐明它们如何被用于指导AI决策。该框架提供了一种机制，通过评估规范世界中状态转换间的偏好变化来评价规范与价值观之间的对齐程度。利用这一形式化方法，AI开发者和伦理学家可以更好地设计和评估AI系统，以确保它们与人类价值观和谐运作。所提出的方法论在从强调福祉的推荐系统到优先考虑安全的自动驾驶汽车等广泛应用中具有潜力。
英文摘要：
As artificial intelligence (AI) systems become increasingly integrated into various domains, ensuring that they align with human values becomes critical. This paper introduces a novel formalism to quantify the alignment between AI systems and human values, using Markov Decision Processes (MDPs) as the foundational model. We delve into the concept of values as desirable goals tied to actions and norms as behavioral guidelines, aiming to shed light on how they can be used to guide AI decisions. This framework offers a mechanism to evaluate the degree of alignment between norms and values by assessing preference changes across state transitions in a normative world. By utilizing this formalism, AI developers and ethicists can better design and evaluate AI systems to ensure they operate in harmony with human values. The proposed methodology holds potential for a wide range of applications, from recommendation systems emphasizing well-being to autonomous vehicles prioritizing safety.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
