量化智能体间的错位:迈向对齐的社会技术理解
Quantifying Misalignment Between Agents: Towards a Sociotechnical Understanding of Alignment
AI总结:
本文针对多智能体间复杂错位问题,提出一种基于计算社会科学的量化模型,通过智能体加权偏好冲突计算错位分数,仿真和案例研究证明其能有效提升社会技术环境的解释力并指导AI对齐设计。
摘要:
关于对齐问题的现有研究主要集中于:(1) 对齐问题的定性描述;(2) 试图通过关注价值规范和学习来使AI行动与人类利益相一致;和/或 (3) 关注单一智能体或将人类视为单一整体。近期社会技术方法强调,需要理解多个人类与AI智能体之间复杂的错位。我们通过将人类争议的计算社会科学模型应用于对齐问题来填补这一空白。我们的模型量化了在各类问题领域中,具有潜在冲突目标的大型、多样化智能体群体中的错位。我们框架中的错位分数取决于观察到的智能体群体、相关领域以及智能体加权偏好之间的冲突。通过仿真,我们展示了模型如何捕捉不同场景下错位的直观特征。随后我们将模型应用于两个案例研究(包括自动驾驶场景),展示其实用性。我们的方法为复杂社会技术环境提供了更强的解释力,并能为现实应用中设计更对齐的AI系统提供参考。
英文摘要:
Existing work on the alignment problem has focused mainly on (1) qualitative descriptions of the alignment problem; (2) attempting to align AI actions with human interests by focusing on value specification and learning; and/or (3) focusing on a single agent or on humanity as a monolith. Recent sociotechnical approaches highlight the need to understand complex misalignment among multiple human and AI agents. We address this gap by adapting a computational social science model of human contention to the alignment problem. Our model quantifies misalignment in large, diverse agent groups with potentially conflicting goals across various problem areas. Misalignment scores in our framework depend on the observed agent population, the domain in question, and conflict between agents' weighted preferences. Through simulations, we demonstrate how our model captures intuitive aspects of misalignment across different scenarios. We then apply our model to two case studies, including an autonomous vehicle setting, showcasing its practical utility. Our approach offers enhanced explanatory power for complex sociotechnical environments and could inform the design of more aligned AI systems in real-world applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。