arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.12849cs.HCcs.AIcs.CY
收藏

学习在高风险环境中为人类提供建议

Learning to Advise Humans in High-Stakes Settings

University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Iowa(爱荷华大学)

Nicholas Wolczynski, Maytal Saar-Tsechansky, Tong Wang

摘要:

高风险AI辅助决策(AIaDM)环境中的专家决策者(DM)在做出最终决策之前,会接收并协调来自AI系统的建议。我们确定这些设置的不同属性,这是开发AIaDM模型,有效地提高团队绩效的关键。第一,模式草案因动用决策资源(例如,时间和精力),以协调与自己的判断相矛盾的人工智能建议。其次,AIaDM设置中的DM表现出算法判断行为(ADB),即,对于任何给定的决策任务,不完全接受或拒绝算法建议的特殊倾向。人类的和解成本和不完美的自由裁量权行为引入了开发人工智能系统的需求,这些系统(1)有选择地提供建议,(2)利用人类合作伙伴的ADB来最大限度地提高团队的决策准确性,同时规范和解成本,(3)本质上是可解释的。我们将开发AI以在AIaDM环境中为人类提供建议的任务称为学习建议,我们首先介绍了AI辅助团队(AIaT)-学习框架。我们实例化我们的框架来开发TeamRules(TR):一种为AIaDM设置生成基于规则的模型和建议的算法。TR被优化为选择性地建议人类,并通过利用人类伙伴的ADB来权衡协调成本和给定环境的团队准确性。对具有各种模拟人类准确性和判断力行为的合成和真实世界基准数据集的评估表明,TR在可解释的,基于规则的替代方案上稳健地提高了团队的目标。

英文摘要:

Expert decision-makers (DMs) in high-stakes AI-assisted decision-making (AIaDM) settings receive and reconcile recommendations from AI systems before making their final decisions. We identify distinct properties of these settings which are key to developing AIaDM models that effectively benefit team performance. First, DMs incur reconciliation costs from exerting decision-making resources (e.g., time and effort) when reconciling AI recommendations that contradict their own judgment. Second, DMs in AIaDM settings exhibit algorithm discretion behavior (ADB), i.e., an idiosyncratic tendency to imperfectly accept or reject algorithmic recommendations for any given decision task. The human's reconciliation costs and imperfect discretion behavior introduce the need to develop AI systems which (1) provide recommendations selectively, (2) leverage the human partner's ADB to maximize the team's decision accuracy while regularizing for reconciliation costs, and (3) are inherently interpretable. We refer to the task of developing AI to advise humans in AIaDM settings as learning to advise and we address this task by first introducing the AI-assisted Team (AIaT)-Learning Framework. We instantiate our framework to develop TeamRules (TR): an algorithm that produces rule-based models and recommendations for AIaDM settings. TR is optimized to selectively advise a human and to trade-off reconciliation costs and team accuracy for a given environment by leveraging the human partner's ADB. Evaluations on synthetic and real-world benchmark datasets with a variety of simulated human accuracy and discretion behaviors show that TR robustly improves the team's objective across settings over interpretable, rule-based alternatives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑