Natural disasters ravage the world's cities, valleys, and shores on a regular basis. Deploying precise and efficient computational mechanisms for assessing infrastructure damage is essential to channel resources and minimize the loss of life. Using a dataset that includes labeled pre- and post- disaster satellite imagery, we take a machine learning-based remote sensing approach and train multiple convolutional neural networks (CNNs) to assess building damage on a per-building basis. We present a novel methodology of interpretable deep learning that seeks to explicitly investigate the most useful modalities of information in the training data to create an accurate classification model. We also investigate which loss functions best optimize these models. Our findings include that ordinal-cross entropy loss is the most optimal criterion for optimization to use and that including the type of disaster that caused the damage in combination with pre- and post-disaster training data most accurately predicts the level of damage caused. Further, we make progress in the qualitative representation of which parts of the images that the model is using to predict damage levels, through gradient-weighted class activation mapping (Grad-CAM). Our research seeks to computationally contribute to aiding in this ongoing and growing humanitarian crisis, heightened by anthropogenic climate change.
Multi-Modal Attention for Automated Disaster Damage Assessment Using Remote Sensing Imagery and Deep Learning
Built Environment Department, College of Science and Technology, North Carolina A&T State University(北卡罗来纳农工州立大学科技学院建筑环境系);United Nations University Institute for Water, Environment and Health(联合国大学水、环境与健康研究所)
A Deep Learning framework for building damage assessment using VHR SAR and geospatial data: demonstration on the 2023 Turkiye Earthquake
Department of Electrical, Computer and Biomedical Engineering, University of Pavia(帕维亚大学电气、计算机与生物医学工程系);Department of Engineering, University of Sannio(萨诺尼奥大学工程系);Italian Space Agency (ASI)(意大利航天局)
Cross-View Geolocalization and Disaster Mapping with Street-View and VHR Satellite Imagery: A Case Study of Hurricane IAN
Technical University of Munich(慕尼黑工业大学);University of the Bundeswehr Munich(慕尼黑联邦国防军大学);China University of Mining and Technology(中国矿业大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);Tongji University(同济大学)
xBD: A Dataset for Assessing Building Damage from Satellite Imagery
Carnegie Mellon University(卡内基梅隆大学);Software Engineering Institute(软件工程研究所);Defense Innovation Unit(国防创新部门);Department of Defense(国防部);CrowdAI, Inc.(CrowdAI公司)
我们提出了xBD,一个新的,大规模的数据集,用于人道主义援助和灾难恢复研究的变化检测和建筑物损坏评估的进步。自然灾害响应需要准确了解受灾地区受损的建筑物。目前的应对战略要求在灾害发生后24-48小时内进行现场损失评估。将航空图像与计算机视觉算法相结合,以评估损害并减少对人类生命的潜在危险,这方面存在着巨大的潜力。xBD与多个灾害响应机构合作,提供各种灾害事件的事件前和事件后卫星图像,包括建筑物多边形,损坏程度的顺序标签和相应的卫星元数据。此外,数据集包含环境因素(如火、水和烟)的边界框和标签。xBD是迄今为止最大的建筑物损坏评估数据集,包含45,362 km \textsuperscript{2}图像中的850,736个建筑物注释。
Deep Learning for Pavement Condition Evaluation Using Satellite Imagery
Department of Civil and Environmental Engineering, University of Houston(土木与环境工程系,休斯顿大学);College of Business, North Dakota State University(商学院,北达科他州立大学);Department of Civil and Environmental Engineering, University of South Florida(土木与环境工程系,佛罗里达州立大学)
NeuroPhysNet: A FitzHugh-Nagumo-Based Physics-Informed Neural Network Framework for Electroencephalograph (EEG) Analysis and Motor Imagery Classification
University of Technology Sydney(新南威尔士大学悉尼分校);Queensland University of Technology(昆士兰理工大学)
Benchmark Dataset for Automatic Damaged Building Detection from Post-Hurricane Remotely Sensed Imagery
New York University(纽约大学);University of the Philippines Diliman(菲律宾大学迪里曼分校);University of Washington(华盛顿大学);German Corporation for International Cooperation GmbH (GIZ)(德国国际合作机构(GIZ))
Flood-DamageSense: Multimodal Mamba with Multitask Learning for Building Flood Damage Assessment using SAR Remote Sensing Imagery
Urban Resilience.AI Lab(城市韧性人工智能实验室);Zachry Department of Civil and Environmental Engineering(扎克里土木与环境工程系);Texas A&M University(德克萨斯A&M大学);College Station, TX(学院站, 德克萨斯)
Multiclass Post-Earthquake Building Assessment Integrating High-Resolution Optical and SAR Satellite Imagery, Ground Motion, and Soil Data with Transformers
Department of Civil and Environmental Engineering, University of Houston, TX, USA(土木与环境工程系,德克萨斯大学);Department of Electrical and Computer Engineering, University of Houston, TX, USA(电气与计算机工程系,德克萨斯大学);Department of Earth and Atmospheric Science, University of Houston, TX, USA(地球与大气科学系,德克萨斯大学);German Aerospace Center (DLR), Microwaves and Radar Institute, Munich, Germany(德国航天中心(DLR)微波与雷达研究所)
DamageArbiter: A Multimodal Arbitration Framework for Disaster Damage Assessment from Street-View Imagery
organization= Department of Geography, Texas A\&M University , city= College Station , country= USA;organization= Department of Landscape Architecture \& Urban Planning, Texas A\&M University , city= College Station , country= USA;organization= Department of Industrial;Systems Engineering, University of Florida , city= Gainesville , country= USA;organization= Spatial Sciences Institute, University of Southern California , city= Los Angeles , country= USA;organization= Department of Geography;Sustainability, University of Tennessee , city= Knoxville , country= USA
Bridge Damage Detection from Low-Light UAV Imagery via Degradation-Aware Mixture-of-Experts Enhancement
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Sustainability X-Lab, The University of Hong Kong(香港大学可持续发展X实验室);School of Architecture, Building, and Civil Engineering, Loughborough University(拉夫堡大学建筑、建造与土木工程学院);Department of Engineering Science, University of Oxford(牛津大学工程科学系);Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology(香港科技大学土木与环境工程系)
Smart Transfer: Leveraging Vision Foundation Model for Rapid Building Damage Mapping with Post-Earthquake VHR Imagery
Department of Geography, National University of Singapore(新加坡国立大学地理系);Urban Governance and Design Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)城市治理与设计学域);School of Environment and Spatial Informatics, China University of Mining and Technology(中国矿业大学环境与空间信息学院);Disaster Management Institute, Istanbul Technical University(伊斯坦布尔技术大学灾害管理研究所);Department of Complexity Science and Engineering, University of Tokyo(东京大学复杂科学与工程系);School of Automation, Southeast University(东南大学自动化学院)
Decoding the Disaster: Multi-Task Geospatial Reasoning with Vision-Language Models and Crowdsourced Imagery for Disaster Mapping
Shandong University of Science and Technology(山东科技大学);Technical University of Munich(慕尼黑工业大学);Wuhan University(武汉大学);Tsinghua University(清华大学);Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心);University of Iceland(冰岛大学)
Hyperlocal disaster damage assessment using bi-temporal street-view imagery and pre-trained vision models
Department of Geography, Texas A&M University(地理系,德克萨斯A&M大学);Department of Geography, Pennsylvania State University(地理系,宾夕法尼亚州立大学);Department of Geography and Sustainability, University of Tennessee(地理与可持续发展系,田纳西大学);Spatial Sciences Institute, University of Southern California(空间科学研究所,南加州大学)