arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.01611cs.CY
收藏

一个基于可解释性方法的多层模型审计框架

A Framework for Auditing Multilevel Models using Explainability Methods

Debarati Bhaumik, Diptish Dey, Subhradeep Kayal

摘要:

多级模型的应用通常会导致基于一组输入特征的组或层次内的二进制分类。为了以透明和合乎道德的方式应用这些模式,需要制定健全的审计框架。在本文中,提出了一个审计框架的技术评估回归多层膜。重点是三个方面,模型,歧视,透明度和可解释性。这些方面随后被划分为子方面。为这些子方面中的每一个识别贡献者,诸如MLM组间公平性、特征贡献顺序和聚合特征贡献。为了衡量贡献者的业绩,该框架提出了一份关键绩效指标短名单。交通灯风险评估方法进一步耦合到这些KPI。为了评估透明度和可解释性,使用了不同的可解释性方法(SHAP和LIME),并将其与使用定量方法和机器学习建模的模型内在方法进行了比较。使用开源数据集,对模型进行训练和测试,并计算KPI。它表明,流行的可解释性方法,如SHAP和石灰,在解释这些模型时,准确性不佳。它们无法预测特征重要性的顺序、大小,有时甚至无法预测特征贡献的性质。对于其他贡献因素,如集团公平性及其相关的关键绩效指标,也进行了类似的分析和计算,目的是增加拟议审计框架的深度。该框架预计将协助监管机构在企业中使用多级二项式分类模型对人工智能系统进行符合性评估。这也将有利于企业部署多层膜是未来的证明,并与欧盟委员会提出的人工智能法规保持一致。

英文摘要:

Applications of multilevel models usually result in binary classification within groups or hierarchies based on a set of input features. For transparent and ethical applications of such models, sound audit frameworks need to be developed. In this paper, an audit framework for technical assessment of regression MLMs is proposed. The focus is on three aspects, model, discrimination, and transparency and explainability. These aspects are subsequently divided into sub aspects. Contributors, such as inter MLM group fairness, feature contribution order, and aggregated feature contribution, are identified for each of these sub aspects. To measure the performance of the contributors, the framework proposes a shortlist of KPIs. A traffic light risk assessment method is furthermore coupled to these KPIs. For assessing transparency and explainability, different explainability methods (SHAP and LIME) are used, which are compared with a model intrinsic method using quantitative methods and machine learning modelling. Using an open source dataset, a model is trained and tested and the KPIs are computed. It is demonstrated that popular explainability methods, such as SHAP and LIME, underperform in accuracy when interpreting these models. They fail to predict the order of feature importance, the magnitudes, and occasionally even the nature of the feature contribution. For other contributors, such as group fairness and their associated KPIs, similar analysis and calculations have been performed with the aim of adding profundity to the proposed audit framework. The framework is expected to assist regulatory bodies in performing conformity assessments of AI systems using multilevel binomial classification models at businesses. It will also benefit businesses deploying MLMs to be future proof and aligned with the European Commission proposed Regulation on Artificial Intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑