arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2507.06263cs.CYcs.AI
收藏

情感对齐设计策略

The Emotional Alignment Design Policy

University of California, Riverside(加州大学河滨分校);New York University(纽约大学)

Eric Schwitzgebel, Jeff Sebo

AI总结:

提出情感对齐设计策略,要求人工实体引发的用户情绪反应与其能力及道德地位相称,并探讨实施中尊重自主权、应对分歧及处理道德地位实体等挑战。

摘要:

根据我们所谓的情感对齐设计策略,人工实体应被设计为引发用户的情绪反应,这些反应应恰当地反映实体的能力与道德地位,或缺乏这些能力与道德地位。这一原则可能以两种方式被违反:设计一个引发比其能力与道德地位所应得的更强或更弱的情绪反应的人工系统(过度反应或反应不足),或设计一个引发错误类型情绪反应的系统(击中错误目标)。尽管这一策略看似具有吸引力,但实际实施面临若干挑战,包括:我们如何在促进适当反应的同时尊重用户自主权?我们应如何应对专家与公众在事实和价值方面的分歧与不确定性?如果情感对齐似乎要求创造或消灭具有道德地位的实体,该怎么办?设计应在多大程度上符合而非试图改变用户的假设与态度?

英文摘要:

According to what we call the Emotional Alignment Design Policy, artificial entities should be designed to elicit emotional reactions from users that appropriately reflect the entities' capacities and moral status, or lack thereof. This principle can be violated in two ways: by designing an artificial system that elicits stronger or weaker emotional reactions than its capacities and moral status warrant (overshooting or undershooting), or by designing a system that elicits the wrong type of emotional reaction (hitting the wrong target). Although presumably attractive, practical implementation faces several challenges including: How can we respect user autonomy while promoting appropriate responses? How should we navigate expert and public disagreement and uncertainty about facts and values? What if emotional alignment seems to require creating or destroying entities with moral status? To what extent should designs conform to versus attempt to alter user assumptions and attitudes?

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑