arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.04058cs.AI
收藏

策略学习中的解释设计:诱导无害响应的充分解释

Explanation Design in Strategic Learning: Sufficient Explanations That Induce Non-harmful Responses

CISPA Helmholtz Center for Information Security(CISPA海德堡信息安全中心);Mizuho–DL Financial Technology, Co., Ltd.(Mizuho-DL金融科技有限公司);University of Michigan(密歇根大学);Saarland University(萨尔兰州大学)

Kiet Q. H. Vo, Siu Lun Chau, Masahiro Kato, Yixin Wang, Krikamol Muandet

AI总结:

研究算法决策中策略性智能体的解释设计问题,提出基于行动推荐的解释(ARexes),证明其在条件同质性假设下足以诱导无害响应,并设计联合优化预测模型与解释策略的学习程序,实验表明该方法能兼顾预测性能与智能体效用。

摘要:

我们研究算法决策中涉及策略性智能体的解释设计问题,这些智能体可能会根据对决策者(DM)预测模型的解释而修改其输入。随着对透明算法系统需求的不断增长,大多数先前的工作假设完全披露模型作为默认解决方案。然而在实践中,诸如金融机构之类的DM通常仅通过解释来披露部分模型信息。这种部分披露可能导致智能体误解模型,并采取在不知情情况下损害其效用的行动。一个关键的开放性问题是,DM如何以一种避免损害策略性智能体的方式传达解释,同时仍支持其自身的决策目标(例如,最小化预测误差)。在这项工作中,我们分析了著名的解释方法,并建立了一个必要条件,以防止解释误导智能体采取自我损害的行动。此外,在条件同质性假设下,我们证明了基于行动推荐的解释(ARexes)足以实现无害响应,这映射了信息设计中的显示原理。为了展示如何在实践中操作化ARexes,我们提出了一种简单学习程序,联合优化预测模型和解释策略。在合成和真实世界任务上的实验表明,ARexes允许DM优化其模型的预测性能,同时保留智能体的效用,为安全有效的部分模型披露提供了更精细的策略。

英文摘要:

We study the design of explanations in algorithmic decision-making with strategic agents, individuals who may modify their inputs in response to explanations of a decision maker's (DM's) predictive model. While the demand for algorithmic transparency has led much prior work to assume full model disclosure, in practice DMs typically provide only partial information via explanations, which can cause agents to misinterpret the model and take actions that unintentionally reduce their own utility. A central open question is therefore how DMs should communicate explanations that avoid harming strategic agents while still supporting their own goals, e.g., minimising predictive error. In this work, we analyse widely used explanation methods and establish a necessary condition to prevent explanations from inducing self-harming responses. Furthermore, we show that action recommendation-based explanations (ARexes), which encompass counterfactual explanations, are sufficient to induce all non-harmful responses. Under a conditional homogeneity assumption, this sufficiency extends to ARex-generating methods, echoing the revelation principle in information design. To demonstrate their practical utility, we introduce a simple learning procedure that jointly optimises the predictive model and the explanation-generating policy. Experiments on both synthetic and real-world tasks show that ARexes enable DMs to achieve high predictive performance while preserving agents' utility, offering a principled strategy for safe and effective partial model disclosure.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑