arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.01685cs.AIcs.LG
收藏

Agent Incentives: A Causal Perspective

DeepMind;University of Oxford(牛津大学);University of Toronto(多伦多大学);Vector Institute(向量研究所)

Tom Everitt, Ryan Carey, Eric Langlois, Pedro A Ortega, Shane Legg

英文摘要:

We present a framework for analysing agent incentives using causal influence diagrams. We establish that a well-known criterion for value of information is complete. We propose a new graphical criterion for value of control, establishing its soundness and completeness. We also introduce two new concepts for incentive analysis: response incentives indicate which changes in the environment affect an optimal decision, while instrumental control incentives establish whether an agent can influence its utility via a variable X. For both new concepts, we provide sound and complete graphical criteria. We show by example how these results can help with evaluating the safety and fairness of an AI system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑