arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.02617cs.AIcs.LG
收藏

体贴:目标,副作用和决定如何行动

Be Considerate: Objectives, Side Effects, and Deciding How to Act

University of Toronto(多伦多大学);Vector Institute(向量研究所);Schwartz Reisman Institute for Technology and Society(施瓦茨·赖斯曼技术与社会研究所)

Parand Alizadeh Alamdari, Toryn Q. Klassen, Rodrigo Toro Icarte, Sheila A. McIlraith

摘要:

最近在人工智能安全方面的工作强调,在顺序决策中,目标往往是不明确或不完整的。这使代理人有自由裁量权,以可能导致不良结果的方式实现所述目标。我们认为,为了学会安全地行动,强化学习(RL)主体应该考虑其行为对环境中其他人的福祉和代理的影响,包括其他代理和反应过程。我们赋予RL代理的能力,考虑这种影响,通过增加他们的奖励的基础上预期的未来回报的环境中的其他人,提供不同的标准来表征的影响。我们进一步赋予这些代理人的能力,差异化的因素,这种影响到他们的决策,表现出的行为,范围从自我为中心的自我少,在网格世界环境中的实验证明。

英文摘要:

Recent work in AI safety has highlighted that in sequential decision making, objectives are often underspecified or incomplete. This gives discretion to the acting agent to realize the stated objective in ways that may result in undesirable outcomes. We contend that to learn to act safely, a reinforcement learning (RL) agent should include contemplation of the impact of its actions on the wellbeing and agency of others in the environment, including other acting agents and reactive processes. We endow RL agents with the ability to contemplate such impact by augmenting their reward based on expectation of future return by others in the environment, providing different criteria for characterizing impact. We further endow these agents with the ability to differentially factor this impact into their decision making, manifesting behavior that ranges from self-centred to self-less, as demonstrated by experiments in gridworld environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑