arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.06019cs.CVcs.AIeess.IVeess.SP
收藏

BRIGHT:一个全球分布的多模态建筑损毁评估数据集,具有甚高分辨率,用于全天候灾害响应

BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response

Graduate School of Frontier Sciences, The University of Tokyo(东京大学前沿科学研究生院);RIKEN Center for Advanced Intelligence Project (AIP), RIKEN(日本理化学研究院先进智能项目中心);Department of Photogrammetry and Remote Sensing, ETH Zürich(苏黎世联邦理工学院测绘与遥感系);Microsoft Research Asia(微软亚洲研究院)

Hongruixuan Chen, Jian Song, Olivier Dietrich, Clifford Broni-Bediako, Weihao Xuan, Junjue Wang, Xinlei Shao, Yimin Wei, Junshi Xia, Cuiling Lan, Konrad Schindler, Naoto Yokoya

AI总结:

本文提出BRIGHT,一个全球分布、事件多样的多模态建筑损毁评估数据集,结合甚高分辨率光学与SAR影像,支持全天候灾害响应,并验证了七个AI模型的性能。

摘要:

灾害事件在世界各地发生,对人类生命和财产造成重大损害。地球观测(EO)数据能够实现快速、全面的建筑损毁评估(BDA),这是在灾害发生后减少人员伤亡和为救灾工作提供信息的关键能力。近期研究聚焦于开发人工智能模型,以实现对未见灾害事件的准确测绘,主要使用光学地球观测数据。然而,基于光学数据的解决方案仅限于晴朗天气和白天时段,无法对灾害做出及时响应。整合多模态(MM)地球观测数据,特别是光学与合成孔径雷达(SAR)影像的结合,使得提供全天候、昼夜不间断的灾害响应成为可能。尽管潜力巨大,但鲁棒的多模态人工智能模型的发展一直受到缺乏合适基准数据集的制约。在本文中,我们提出了一个使用甚高分辨率光学和SAR影像的建筑损毁评估数据集(BRIGHT),以支持基于人工智能的全天候灾害响应。据我们所知,BRIGHT是首个开放获取、全球分布、事件多样化的多模态数据集,专门为支持基于人工智能的灾害响应而精心策划。它涵盖了全球14个地区的五种自然灾害和两种人为灾害,特别关注最需要外部援助的发展中国家。BRIGHT中的光学和SAR影像空间分辨率在0.3至1米之间,提供了对单个建筑的详细表征,非常适合精确的建筑损毁评估。在我们的实验中,我们测试了七个先进的人工智能模型,使用我们的BRIGHT进行训练,以验证其可迁移性和鲁棒性。数据集和代码可在https://github.com/ChenHongruixuan/BRIGHT获取。BRIGHT也是2025年IEEE GRSS数据融合竞赛的官方数据集。

英文摘要:

Disaster events occur around the world and cause significant damage to human life and property. Earth observation (EO) data enables rapid and comprehensive building damage assessment (BDA), an essential capability in the aftermath of a disaster to reduce human casualties and to inform disaster relief efforts. Recent research focuses on the development of AI models to achieve accurate mapping of unseen disaster events, mostly using optical EO data. However, solutions based on optical data are limited to clear skies and daylight hours, preventing a prompt response to disasters. Integrating multimodal (MM) EO data, particularly the combination of optical and SAR imagery, makes it possible to provide all-weather, day-and-night disaster responses. Despite this potential, the development of robust multimodal AI models has been constrained by the lack of suitable benchmark datasets. In this paper, we present a BDA dataset using veRy-hIGH-resoluTion optical and SAR imagery (BRIGHT) to support AI-based all-weather disaster response. To the best of our knowledge, BRIGHT is the first open-access, globally distributed, event-diverse MM dataset specifically curated to support AI-based disaster response. It covers five types of natural disasters and two types of man-made disasters across 14 regions worldwide, with a particular focus on developing countries where external assistance is most needed. The optical and SAR imagery in BRIGHT, with a spatial resolution between 0.3-1 meters, provides detailed representations of individual buildings, making it ideal for precise BDA. In our experiments, we have tested seven advanced AI models trained with our BRIGHT to validate the transferability and robustness. The dataset and code are available at https://github.com/ChenHongruixuan/BRIGHT. BRIGHT also serves as the official dataset for the 2025 IEEE GRSS Data Fusion Contest.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑