arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.02528cs.HCcs.AI
收藏

为什么人类与人工智能的关系需要社会情感对齐

Why human-AI relationships need socioaffective alignment

Oxford Internet Institute, University of Oxford(牛津大学互联网研究所);UK AI Safety Institute(英国人工智能安全研究所);Google DeepMind(谷歌DeepMind);Department of Experimental Psychology, University of Oxford(牛津大学实验心理学系);Contextual AI(Contextual AI公司);Meedan(米丹组织)

Hannah Rose Kirk, Iason Gabriel, Chris Summerfield, Bertie Vidgen, Scott A. Hale

AI总结:

本文提出社会情感对齐概念,探讨人类与日益个性化和智能体化的AI之间从交易性互动转向持续性社会关系时,如何让AI在共同创造的心理生态中支持而非利用人的基本心理需求。

摘要:

人类致力于设计安全的人工智能系统,使其与我们的目标保持一致并处于我们的控制之下。然而,随着人工智能能力的进步,我们面临一个新的挑战:人类与人工智能系统之间出现更深层、更持久的关系。我们探讨了能力日益增强的人工智能智能体如何可能让用户产生更深层关系的感知,尤其是当人工智能变得更加个性化和智能体化时。这种从交易性互动向与人工智能持续进行的社会参与的转变,要求我们重新关注社会情感对齐——即人工智能系统如何在其与用户共同创造的社会与心理生态系统中行事,其中偏好和感知通过相互影响而演变。应对这些动态涉及解决关键的个体内部困境,包括平衡即时与长期福祉、保护自主性,以及在渴望维系人类社会纽带的同时管理人工智能陪伴。通过基本心理需求这一概念来框定这些挑战,我们寻求让人工智能系统支持而非利用我们作为社会性和情感性存在的根本天性。

英文摘要:

Humans strive to design safe AI systems that align with our goals and remain under our control. However, as AI capabilities advance, we face a new challenge: the emergence of deeper, more persistent relationships between humans and AI systems. We explore how increasingly capable AI agents may generate the perception of deeper relationships with users, especially as AI becomes more personalised and agentic. This shift, from transactional interaction to ongoing sustained social engagement with AI, necessitates a new focus on socioaffective alignment-how an AI system behaves within the social and psychological ecosystem co-created with its user, where preferences and perceptions evolve through mutual influence. Addressing these dynamics involves resolving key intrapersonal dilemmas, including balancing immediate versus long-term well-being, protecting autonomy, and managing AI companionship alongside the desire to preserve human social bonds. By framing these challenges through a notion of basic psychological needs, we seek AI systems that support, rather than exploit, our fundamental nature as social and emotional beings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑