Deep Self-Supervised Disturbance Mapping with the OPERA Sentinel-1 Radiometric Terrain Corrected SAR Backscatter Product
University of California - Los Angeles(加利福尼亚大学洛杉矶分校);Jet Propulsion Laboratory, California Institute of Technology(加州理工学院喷气推进实验室);Joint Institute for Regional Earth System Science and Engineering, University of California - Los Angeles(加利福尼亚大学洛杉矶分校区域地球系统科学与工程联合研究所)
Harris Hardiman-Mostow, Charles Marshak, Alexander L. Handwerger
本文基于 OPERA RTC-S1 数据训练无需标签的自监督 vision transformer,通过逐像素基线分布偏差检测地表扰动,并在三地灾害事件中取得优于现有方法的结果。
摘要:
绘制地表扰动图可为灾害响应、资源与生态系统管理以及气候适应工作提供支持。合成孔径雷达(SAR)是扰动制图的宝贵工具,能够不受天气或光照条件影响,提供一致的地面时间序列影像。尽管 SAR 在扰动制图方面具有潜力,但将 SAR 数据处理为可直接分析的格式需要专业知识和大量计算资源,对于大规模全球分析而言尤其如此。2023 年 10 月,NASA 的“遥感分析面向终端用户的观测产品”(Observational Products for End-Users from Remote Sensing Analysis,OPERA)项目发布了来自 Sentinel-1 的近全球辐射地形校正 SAR 后向散射(RTC-S1)数据集,提供公开可用、可直接分析的 SAR 影像。在本研究中,我们利用这一新数据集系统分析地表扰动。由于标注 SAR 数据往往极其耗时,我们在 OPERA RTC-S1 数据上训练了一个自监督 vision transformer——该模型训练不需要标签——以根据基线影像集合估计逐像素分布,并在观测显著偏离建模分布时评估扰动。为测试模型的能力和通用性,我们评估了来自世界三个不同地区的三种不同自然灾害,它们代表高强度、突发性扰动。在各个事件中,我们的方法都产生了高质量勾绘结果:F1 分数超过 0.6,精确率-召回率曲线下面积超过 0.65,并持续优于现有 SAR 扰动方法。我们的研究结果表明,自监督 vision transformer 非常适合全球扰动制图,并且能够成为业务化近全球扰动监测的宝贵工具,尤其是在不存在标注数据时。
英文摘要:
Mapping land surface disturbances supports disaster response, resource and ecosystem management, and climate adaptation efforts. Synthetic aperture radar (SAR) is an invaluable tool for disturbance mapping, providing consistent time-series images of the ground regardless of weather or illumination conditions. Despite SAR's potential for disturbance mapping, processing SAR data to an analysis-ready format requires expertise and significant compute resources, particularly for large-scale global analysis. In October 2023, NASA's Observational Products for End-Users from Remote Sensing Analysis (OPERA) project released the near-global Radiometric Terrain Corrected SAR backscatter from Sentinel-1 (RTC-S1) dataset, providing publicly available, analysis-ready SAR imagery. In this work, we utilize this new dataset to systematically analyze land surface disturbances. As labeling SAR data is often prohibitively time-consuming, we train a self-supervised vision transformer - which requires no labels to train - on OPERA RTC-S1 data to estimate a per-pixel distribution from the set of baseline imagery and assess disturbances when there is significant deviation from the modeled distribution. To test our model's capability and generality, we evaluate three different natural disasters - which represent high-intensity, abrupt disturbances - from three different regions of the world. Across events, our approach yields high quality delineations: F1 scores exceeding 0.6 and Areas Under the Precision-Recall Curve exceeding 0.65, consistently outperforming existing SAR disturbance methods. Our findings suggest that a self-supervised vision transformer is well-suited for global disturbance mapping and can be a valuable tool for operational, near-global disturbance monitoring, particularly when labeled data does not exist.
University of Oxford(牛津大学);University of Valencia(瓦伦西亚大学)
High resolution remote sensing imagery is used in broad range of tasks, including detection and classification of objects. High-resolution imagery is however expensive, while lower resolution imagery is often freely available and can be used by the public for range of social good applications. To that end, we curate a multi-spectral multi-image super-resolution dataset, using PlanetScope imagery from the SpaceNet 7 challenge as the high resolution reference and multiple Sentinel-2 revisits of the same imagery as the low-resolution imagery. We present the first results of applying multi-image s…
NOVA-LINCS;Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa(里斯本新大学科学与技术学院)
Mapping structures such as settlements, roads, individual houses and any other types of artificial structures is of great importance for the analysis of urban growth, masking, image alignment and, especially in the studied use case, the definition of Fuel Management Networks (FGC), which protect buildings from forest fires. Current cartography has a low generation frequency and their resolution may not be suitable for extracting small structures such as small settlements or roads, which may lack forest fire protection. In this paper, we use time series data, extracted from Sentinel-1 and 2 con…
Synthetic Aperture Radar (SAR) constitutes a fundamental asset for wide-areas monitoring with high-resolution requirements. The first SAR sensors have given rise to coarse coastal and maritime monitoring applications, including oil spill, ship and ice floes detection. With the upgrade to very high-resolution sensors in the recent years, with relatively new SAR missions such as Sentinel-1, a great deal of data providing a stronger information content has been released, enabling more refined studies on general targets features and thus permitting complex classifications, as for ship classificati…
Global Offshore Wind Infrastructure: Deployment and Operational Dynamics from Dense Sentinel-1 Time Series
Earth Observation Center (EOC), German Aerospace Center (DLR)(地球观测中心(EOC),德国航空航天中心(DLR));Institute for Geography and Geology, University of Wuerzburg(地理与地质研究所,乌尔姆大学)
Clouds are a very important factor in the availability of optical remote sensing images. Recently, deep learning-based cloud detection methods have surpassed classical methods based on rules and physical models of clouds. However, most of these deep models are very large which limits their applicability and explainability, while other models do not make use of the full spectral information in multi-spectral images such as Sentinel-2. In this paper, we propose a lightweight network for cloud detection, fusing multi-scale spectral and spatial features (CDFM3SF) and tailored for processing all sp…
Extending Dynamic World Surface Water Mapping to Sentinel-1 with AlphaEarth Embeddings
Pacific Northwest National Laboratory(太平洋西北国家实验室);NASA Goddard Space Flight Center(美国国家航空航天局戈达德太空飞行中心);Fujitsu Research of America(富士通美国研究院);University of Wisconsin–Madison(威斯康星大学麦迪逊分校)
Geographically-Weighted Weakly Supervised Bayesian High-Resolution Transformer for 200m Resolution Pan-Arctic Sea Ice Concentration Mapping and Uncertainty Estimation using Sentinel-1, RCM, and AMSR2 Data
Department of Geomatics Engineering, Schulich School of Engineering, University of Calgary(地质工程系,Schulich 工程学院,卡尔加里大学)
A Fast Fourier Convolutional Deep Neural Network For Accurate and Explainable Discrimination Of Wheat Yellow Rust And Nitrogen Deficiency From Sentinel-2 Time-Series Data
The University of Leeds(利兹大学);Manchester Metropolitan University(曼彻斯特城市大学);University of Córdoba(科尔多瓦大学);The University of Manchester(曼彻斯特大学);Beijing University of Technology(北京工业大学);Yangzhou University(扬州大学)
Comparative Assessment of Multimodal Earth Observation Data for Soil Moisture Estimation
BEYOND EO Centre, IAASARS, National Observatory of Athens(BEYOND EO中心、IAASARS、雅典国家天文台);Artificial Intelligence, Wageningen University & Research(人工智能,瓦赫宁根大学与研究所)
Beyond Backscatter: InSAR coherence from detected SAR images
Department of Aerospace Engineering, University of the Bundeswehr Munich(联邦国防军 Munich航空航天工程系);Microwaves and Radar Institute, German Aerospace Center (DLR)(德国航空航天中心 (DLR) 微波与雷达研究所)
Self-Supervised Super-Resolution for Sentinel-5P Hyperspectral Images
Université d’Orléans, Université de Tours, CNRS, IDP, UMR 7013(奥尔良大学、图尔大学、法国国家科学研究中心、IDP、UMR 7013);Faculty of Mathematical Sciences, University of Khartoum(数学科学学院,喀土穆大学);ENS Lyon, France(里昂高等师范学院,法国);Laboratory of Physics and Chemistry of the Environment and Space (LPC2E), CNRS UMR 7328, University of Orléans, France(环境与空间物理化学实验室(LPC2E),法国国家科学研究中心UMR 7328,奥尔良大学,法国);Institut universitaire de France (IUF), France(法国国家研究院(IUF),法国)
Université de Bretagne Sud(南布列塔尼大学);IRISA(法国信息与随机系统研究所);CNES(法国国家空间研究中心);Thales Alenia Space(泰雷兹阿莱尼亚宇航公司)
In the field of remote sensing and more specifically in Earth Observation, new data are available every day, coming from different sensors. Leveraging on those data in classification tasks comes at the price of intense labelling tasks that are not realistic in operational settings. While domain adaptation could be useful to counterbalance this problem, most of the usual methods assume that the data to adapt are comparable (they belong to the same metric space), which is not the case when multiple sensors are at stake. Heterogeneous domain adaptation methods are a particular solution to this pr…
Is sub-metre resolution necessary for cocoa mapping? A landscape-stratified evaluation of very high resolution imagery, decametric Earth Observation inputs, and operational products in Cote d'Ivoire
Federal University of São Carlos(圣卡洛斯联邦大学);John Deere(约翰迪尔)
In precision agriculture, detecting productive crop fields is an essential practice that allows the farmer to evaluate operating performance separately and compare different seed varieties, pesticides, and fertilizers. However, manually identifying productive fields is often a time-consuming and error-prone task. Previous studies explore different methods to detect crop fields using advanced machine learning algorithms, but they often lack good quality labeled data. In this context, we propose a high-quality dataset generated by machine operation combined with Sentinel-2 images tracked over ti…
Orion Lab, National Observatory of Athens & National Technical University of Athens(Orion实验室、雅典国家天文观测站及雅典技术大学);Department of Informatics and Telematics, Harokopio University of Athens(信息与电信系、哈罗基奥大学)
Leveraging AI multimodal geospatial foundation models for improved near-real-time flood mapping at a global scale
North Carolina State University(北卡罗来纳州立大学);LabCorp(实验室集团);Humboldt-Universität zu Berlin(柏林洪堡大学);Earth and Life Institute, UCLouvain(鲁汶天主教大学地球与生命研究所);University of Helsinki(赫尔辛基大学);Clark University(克拉克大学);Thünen Institute of Farm Economics(蒂嫩农场经济研究所)
RoughNet: Mapping Arctic Sea Ice Roughness Using Diffusion-Based Super-Resolution of Satellite Imagery
University College London(伦敦大学学院);Alfred Wegener Institute Helmholtz Centre for Polar and Marine Research(阿尔弗雷德·韦格纳极地与海洋研究所亥姆霍兹中心);University of Victoria(维多利亚大学)
JOANNEUM RESEARCH(约阿内姆研究公司);Albert-Ludwigs-University Freiburg(弗赖堡阿尔伯特-路德维希大学);University of Patras(帕特雷大学)
Purpose of review: This paper presents a review of the current state of the art in remote sensing based monitoring of forest disturbances and forest degradation from optical Earth Observation data. Part one comprises an overview of currently available optical remote sensing sensors, which can be used for forest disturbance and degradation mapping. Part two reviews the two main categories of existing approaches: classical image-to-image change detection and time series analysis. Recent findings: With the launch of the Sentinel-2a satellite and available Landsat imagery, time series analysis has…