arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.09197cs.LGcs.LO
收藏

在梯度提升树中实现局部可解释性:特征贡献

Implementing local-explainability in Gradient Boosting Trees: Feature Contribution

Paradigma Digital, S.L.(帕拉迪格玛数字有限公司);Universidad de León(莱昂大学)

Ángel Delgado-Panadero, Beatriz Hernández-Lorca, María Teresa García-Ordás, José Alberto Benítez-Andrades

AI总结:

本文提出一种基于GBDT架构的特征贡献方法,利用节点残差计算特征贡献并还原节点决策序列,为GBDT提供局部可解释性,满足AI伦理分析与GDPR等法规要求。

摘要:

梯度提升决策树(GBDT)是一种基于树集成的强大加性模型。尽管有多种可解释人工智能(XAI)模型通过全局和局部重新解释模型来获取信息,但GBDT的本质使其成为一个黑盒模型。集成中的每棵树本身是一个透明模型,但最终结果是这些树的总和,因此难以澄清。本文开发了一种针对GBDT的特征贡献方法。该方法利用GBDT架构,通过每个节点的残差计算每个特征的贡献。该算法允许在给定预测时计算节点决策序列。理论证明和多次实验已证明我们方法的性能,它不仅是GBDT算法的局部可解释性模型,也是反映GBDT内部行为的独特选项。该提案与在人工智能伦理分析等AI问题中有影响的特征贡献相一致,并符合《通用数据保护条例》(GDPR)等欧洲新法律关于解释权和非歧视的规定。

英文摘要:

Gradient Boost Decision Trees (GBDT) is a powerful additive model based on tree ensembles. Its nature makes GBDT a black-box model even though there are multiple explainable artificial intelligence (XAI) models obtaining information by reinterpreting the model globally and locally. Each tree of the ensemble is a transparent model itself but the final outcome is the result of a sum of these trees and it is not easy to clarify. In this paper, a feature contribution method for GBDT is developed. The proposed method takes advantage of the GBDT architecture to calculate the contribution of each feature using the residue of each node. This algorithm allows to calculate the sequence of node decisions given a prediction. Theoretical proofs and multiple experiments have been carried out to demonstrate the performance of our method which is not only a local explicability model for the GBDT algorithm but also a unique option that reflects GBDTs internal behavior. The proposal is aligned to the contribution of characteristics having impact in some artificial intelligence problems such as ethical analysis of Artificial Intelligence (AI) and comply with the new European laws such as the General Data Protection Regulation (GDPR) about the right to explain and nondiscrimination.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑