地球科学问题的神经网络属性方法:一种新的合成基准数据集
Neural Network Attribution Methods for Problems in Geoscience: A Novel Synthetic Benchmark Dataset
摘要:
尽管神经网络越来越成功地应用于地球科学中的许多问题,但其复杂和非线性的结构使得难以解释其预测,这限制了模型的信任,并且不允许科学家获得关于手头问题的物理见解。在新兴的可解释人工智能(XAI)领域中引入了许多不同的方法,这些方法旨在将网络的预测归因于输入域中的特定特征。XAI方法通常通过使用基准数据集(如用于图像分类的MNIST或ImageNet)进行评估。然而,对于大多数这些数据集,缺乏客观的、理论上推导出的基础事实,这使得在许多情况下对XAI的评估是主观的。此外,专门为地球科学问题设计的基准数据集很少。在这里,我们提供了一个框架,基于使用的可加性分离的功能,生成属性基准数据集的回归问题的地面真相的属性是已知的先验。我们生成一个大型基准数据集,并训练一个完全连接的网络来学习用于模拟的底层函数。然后,我们将来自不同XAI方法的估计热图与地面实况进行比较,以确定特定XAI方法表现良好或较差的示例。我们相信,本文介绍的属性基准对于神经网络在地球科学中的进一步应用以及更客观地评估和准确实施XAI方法具有重要意义,这将增加模型信任并有助于发现新科学。
英文摘要:
Despite the increasingly successful application of neural networks to many problems in the geosciences, their complex and nonlinear structure makes the interpretation of their predictions difficult, which limits model trust and does not allow scientists to gain physical insights about the problem at hand. Many different methods have been introduced in the emerging field of eXplainable Artificial Intelligence (XAI), which aim at attributing the network s prediction to specific features in the input domain. XAI methods are usually assessed by using benchmark datasets (like MNIST or ImageNet for image classification). However, an objective, theoretically derived ground truth for the attribution is lacking for most of these datasets, making the assessment of XAI in many cases subjective. Also, benchmark datasets specifically designed for problems in geosciences are rare. Here, we provide a framework, based on the use of additively separable functions, to generate attribution benchmark datasets for regression problems for which the ground truth of the attribution is known a priori. We generate a large benchmark dataset and train a fully connected network to learn the underlying function that was used for simulation. We then compare estimated heatmaps from different XAI methods to the ground truth in order to identify examples where specific XAI methods perform well or poorly. We believe that attribution benchmarks as the ones introduced herein are of great importance for further application of neural networks in the geosciences, and for more objective assessment and accurate implementation of XAI methods, which will increase model trust and assist in discovering new science.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。