arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.10523cs.CVcs.AIcs.LGphysics.geo-ph
收藏

卷积神经网络在卫星图像建筑物损伤分类中的可解释性

Interpretability in Convolutional Neural Networks for Building Damage Classification in Satellite Imagery

The Academy for Mathematics, Science, and Engineering(数学、科学与工程学院)

Thomas Y. Chen

摘要:

自然灾害经常破坏世界上的城市、山谷和海岸。部署精确和高效的计算机制来评估基础设施的损坏对于引导资源和最大限度地减少生命损失至关重要。使用包括标记的灾前和灾后卫星图像的数据集,我们采取基于机器学习的遥感方法,并训练多个卷积神经网络(CNN)来评估建筑物的损坏。我们提出了一种新的可解释的深度学习方法,旨在明确调查训练数据中最有用的信息模式,以创建准确的分类模型。我们还研究了哪些损失函数最优化这些模型。我们的研究结果包括,顺序交叉熵损失是优化使用的最佳标准,包括造成损害的灾害类型与灾前和灾后训练数据相结合,最准确地预测造成的损害程度。此外,我们取得了进展,在定性表示哪些部分的图像,该模型是用来预测损害程度,通过梯度加权类激活映射(梯度CAM)。我们的研究旨在通过计算来帮助应对这场持续不断且日益严重的人道主义危机,这场危机因人为气候变化而加剧。

英文摘要:

Natural disasters ravage the world's cities, valleys, and shores on a regular basis. Deploying precise and efficient computational mechanisms for assessing infrastructure damage is essential to channel resources and minimize the loss of life. Using a dataset that includes labeled pre- and post- disaster satellite imagery, we take a machine learning-based remote sensing approach and train multiple convolutional neural networks (CNNs) to assess building damage on a per-building basis. We present a novel methodology of interpretable deep learning that seeks to explicitly investigate the most useful modalities of information in the training data to create an accurate classification model. We also investigate which loss functions best optimize these models. Our findings include that ordinal-cross entropy loss is the most optimal criterion for optimization to use and that including the type of disaster that caused the damage in combination with pre- and post-disaster training data most accurately predicts the level of damage caused. Further, we make progress in the qualitative representation of which parts of the images that the model is using to predict damage levels, through gradient-weighted class activation mapping (Grad-CAM). Our research seeks to computationally contribute to aiding in this ongoing and growing humanitarian crisis, heightened by anthropogenic climate change.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑