为什么要做模特?评估LIME的优势和局限性
Why model why? Assessing the strengths and limitations of LIME
摘要:
当涉及到复杂的机器学习模型时,通常被称为黑匣子,理解底层决策过程对于医疗保健和金融服务等领域至关重要,并且当它与自动驾驶汽车等安全关键系统结合使用时也是如此。因此,近年来对可解释的人工智能(xAI)工具和技术的兴趣有所增加。然而,现有xAI框架的有效性,特别是与数据而不是图像相关的算法,仍然是一个开放的研究问题。为了解决这一差距,在本文中,我们研究了局部可解释模型不可知解释(LIME)xAI框架的有效性,该框架是文献中最流行的模型不可知框架之一,特别关注其在使表格模型更具可解释性方面的性能。特别是,我们在表格数据集上应用了几种最先进的机器学习算法,并演示了如何使用LIME来补充传统的性能评估方法。此外,我们通过一个可用性研究,包括参与者谁不熟悉LIME,并通过一个评估框架,这是来自国际标准化组织9241-11:1998标准的整体可用性,评估LIME产生的输出的可理解性。
英文摘要:
When it comes to complex machine learning models, commonly referred to as black boxes, understanding the underlying decision making process is crucial for domains such as healthcare and financial services, and also when it is used in connection with safety critical systems such as autonomous vehicles. As such interest in explainable artificial intelligence (xAI) tools and techniques has increased in recent years. However, the effectiveness of existing xAI frameworks, especially concerning algorithms that work with data as opposed to images, is still an open research question. In order to address this gap, in this paper we examine the effectiveness of the Local Interpretable Model-Agnostic Explanations (LIME) xAI framework, one of the most popular model agnostic frameworks found in the literature, with a specific focus on its performance in terms of making tabular models more interpretable. In particular, we apply several state of the art machine learning algorithms on a tabular dataset, and demonstrate how LIME can be used to supplement conventional performance assessment methods. In addition, we evaluate the understandability of the output produced by LIME both via a usability study, involving participants who are not familiar with LIME, and its overall usability via an assessment framework, which is derived from the International Organisation for Standardisation 9241-11:1998 standard.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。