在招聘、大学录取和贷款等关键领域,算法决策通常基于排名。鉴于这些决策对个人、组织和人群的影响,理解这些决策至关重要——以帮助个人提升其排名位置、设计更好的排名程序并确保法律合规。本文认为,SHAP 等用于分类和回归的可解释性方法不足以应对排名任务,并提出了 ShaRP(Shapley Values for Rankings and Preferences,用于排名和偏好的 Shapley 值),这是一个解释特征对排名结果各方面贡献的框架。ShaRP 可为排名(rank)和 top-k 等各种排名特有的收益函数计算特征贡献,还包含一种新颖的、基于 Shapley 值的方法,用于解释成对偏好结果。我们提供了 ShaRP 的灵活实现,能够在基于分数的排名和排序学习(learning-to-rank)任务中,对表格数据上的排名结果和成对结果进行高效、全面的解释。最后,我们为排名可解释性方法开发了一套全面的评估方法,并通过定性、定量和可用性研究表明,我们的排名感知 QoI 提供了互补的洞察、可有效扩展,并帮助用户在实践中解释排名结果。
英文摘要:
Algorithmic decisions in critical domains such as hiring, college admissions, and lending are often based on rankings. Given the impact of these decisions on individuals, organizations, and population groups, it is essential to understand them - to help individuals improve their ranking position, design better ranking procedures, and ensure legal compliance. In this paper, we argue that explainability methods for classification and regression, such as SHAP, are insufficient for ranking tasks, and present ShaRP - Shapley Values for Rankings and Preferences - a framework that explains the contributions of features to various aspects of a ranked outcome.
ShaRP computes feature contributions for various ranking-specific profit functions, such as rank and top-k, and also includes a novel Shapley value-based method for explaining pairwise preference outcomes. We provide a flexible implementation of ShaRP, capable of efficiently and comprehensively explaining ranked and pairwise outcomes over tabular data, in score-based ranking and learning-to-rank tasks. Finally, we develop a comprehensive evaluation methodology for ranking explainability methods, showing through qualitative, quantitative, and usability studies that our rank-aware QoIs offer complementary insights, scale effectively, and help users interpret ranked outcomes in practice.
Explaining Reinforcement Learning: A Counterfactual Shapley Values Approach
School of Engineering Mathematics and Technology, University of Bristol(布里斯托大学工程数学与技术学院);School of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院)
Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration
Ludwig-Maximilians-Universität (LMU) Munich(慕尼黑大学);John A. Paulson Harvard School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·保尔森工程与应用科学学院);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Wyss Institute for Biologically Inspired Engineering, Harvard University(哈佛大学怀斯生物启发工程研究所)
DistShap: Scalable GNN Explanations with Distributed Shapley Values
Indiana University Bloomington Indiana, USA;Wake Forest University North Carolina, USA;Texas A\&M University Texas, USA;Indiana University Bloomington;Wake Forest University;Texas A\&M University