arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.10596cs.LGcs.AIstat.ML
收藏

机器学习中的反事实推理与反事实资源

Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review

University of Washington(华盛顿大学);Arthur AI(亚瑟人工智能公司)

Sahil Verma, Varich Boonsanong, Minh Hoang, Keegan E. Hines, John P. Dickerson, Chirag Shah

摘要:

机器学习在许多已部署的决策系统中发挥作用,通常以人类利益相关者难以或不可能理解的方式发挥作用。以人类可理解的方式解释机器学习模型的输入和输出之间的关系对于开发基于可信机器学习的系统至关重要。一个新兴的研究主体试图定义机器学习中可解释性的目标和方法。在本文中,我们试图对反事实解释的研究进行回顾和分类,反事实解释是一种特定的解释,它提供了一种联系,如果模型的输入以特定的方式改变,可能会发生什么。机器学习中的反事实可解释性的现代方法与许多国家的既定法律原则相联系,使它们对金融和医疗保健等高影响领域的现场系统具有吸引力。因此,我们设计了一个具有理想特性的反事实解释算法的量规,并对该量规全面评估了目前提出的所有算法。我们的标题提供了不同方法的优点和缺点的简单比较和理解,并作为该领域主要研究主题的介绍。我们还确定了差距,并讨论了有前途的研究方向,在空间的反事实的可解释性。

英文摘要:

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of machine learning models is essential to the development of trustworthy machine learning based systems. A burgeoning body of research seeks to define the goals and methods of explainability in machine learning. In this paper, we seek to review and categorize research on counterfactual explanations, a specific class of explanation that provides a link between what could have happened had input to a model been changed in a particular way. Modern approaches to counterfactual explainability in machine learning draw connections to the established legal doctrine in many countries, making them appealing to fielded systems in high-impact areas such as finance and healthcare. Thus, we design a rubric with desirable properties of counterfactual explanation algorithms and comprehensively evaluate all currently proposed algorithms against that rubric. Our rubric provides easy comparison and comprehension of the advantages and disadvantages of different approaches and serves as an introduction to major research themes in this field. We also identify gaps and discuss promising research directions in the space of counterfactual explainability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑