arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.09903cs.LGcs.AI
收藏

准确性对模型解释的影响

Impact of Accuracy on Model Interpretations

Cornell University(康奈尔大学)

Brian Liu, Madeleine Udell

摘要:

模型解释通常用于从机器学习模型中提取真实世界的见解。这些解释有着广泛的应用;它们可以作为业务建议或用于评估模型偏差。对于数据科学家来说,选择值得信赖的解释来推动现实世界的影响至关重要。这样做需要了解模型的准确性如何影响标准解释工具的质量。在本文中,我们将探讨模型的预测精度如何影响口译质量。我们提出了两个指标来量化解释的质量,并设计了一个实验来测试这些指标如何随模型精度而变化。我们发现,对于可以通过各种方法准确建模的数据集,更简单的方法可以产生更高质量的解释。我们还确定了哪种解释方法最适合较低水平的模型精度。

英文摘要:

Model interpretations are often used in practice to extract real world insights from machine learning models. These interpretations have a wide range of applications; they can be presented as business recommendations or used to evaluate model bias. It is vital for a data scientist to choose trustworthy interpretations to drive real world impact. Doing so requires an understanding of how the accuracy of a model impacts the quality of standard interpretation tools. In this paper, we will explore how a model's predictive accuracy affects interpretation quality. We propose two metrics to quantify the quality of an interpretation and design an experiment to test how these metrics vary with model accuracy. We find that for datasets that can be modeled accurately by a variety of methods, simpler methods yield higher quality interpretations. We also identify which interpretation method works the best for lower levels of model accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑