The Sentinel-2 satellite mission delivers multi-spectral imagery with 13 spectral bands, acquired at three different spatial resolutions. The aim of this research is to super-resolve the lower-resolution (20 m and 60 m Ground Sampling Distance - GSD) bands to 10 m GSD, so as to obtain a complete data cube at the maximal sensor resolution. We employ a state-of-the-art convolutional neural network (CNN) to perform end-to-end upsampling, which is trained with data at lower resolution, i.e., from 40->20 m, respectively 360->60 m GSD. In this way, one has access to a virtually infinite amount of training data, by downsampling real Sentinel-2 images. We use data sampled globally over a wide range of geographical locations, to obtain a network that generalises across different climate zones and land-cover types, and can super-resolve arbitrary Sentinel-2 images without the need of retraining. In quantitative evaluations (at lower scale, where ground truth is available), our network, which we call DSen2, outperforms the best competing approach by almost 50% in RMSE, while better preserving the spectral characteristics. It also delivers visually convincing results at the full 10 m GSD. The code is available at https://github.com/lanha/DSen2
Extending Dynamic World Surface Water Mapping to Sentinel-1 with AlphaEarth Embeddings
Pacific Northwest National Laboratory（太平洋西北国家实验室）；NASA Goddard Space Flight Center（美国国家航空航天局戈达德太空飞行中心）；Fujitsu Research of America（富士通美国研究院）；University of Wisconsin–Madison（威斯康星大学麦迪逊分校）
Improved flood mapping for efficient policy design by fusion of Sentinel-1, Sentinel-2, and Landsat-9 imagery to identify population and infrastructure exposed to floods
Lahore University of Management Sciences (LUMS)（拉合尔管理科学大学（LUMS））
Synthetic Aperture Radar (SAR) data and Interferometric SAR (InSAR) products in particular, are one of the largest sources of Earth Observation data. InSAR provides unique information on diverse geophysical processes and geology, and on the geotechnical properties of man-made structures. However, there are only a limited number of applications that exploit the abundance of InSAR data and deep learning methods to extract such knowledge. The main barrier has been the lack of a large curated and annotated InSAR dataset, which would be costly to create and would require an interdisciplinary team o…
The increasing spatial and temporal resolution of globally available satellite images, such as provided by Sentinel-2, creates new possibilities for researchers to use freely available multi-spectral optical images, with decametric spatial resolution and more frequent revisits for remote sensing applications such as land cover and crop classification (LC&CC), agricultural monitoring and management, environment monitoring. Existing solutions dedicated to cropland mapping can be categorized based on per-pixel based and object-based. However, it is still challenging when more classes of agricultu…
GeoFormer: A Lightweight Swin Transformer for Joint Building Height and Footprint Estimation from Sentinel Imagery
Department of Civil, Architectural and Environmental System Engineering, Sungkyunkwan University（成均馆大学土木、建筑与环境系统工程系）；School of Geography, University of Leeds（利兹大学地理学院）；Interdisciplinary Program for Crisis, Disaster and Risk Management, Sungkyunkwan University（成均馆大学危机、灾害与风险管理跨学科项目）
Scattered trees outside of dense, closed-canopy forests are very important for carbon sequestration, supporting livelihoods, maintaining ecosystem integrity, and climate change adaptation and mitigation. In contrast to trees inside of closed-canopy forests, not much is known about the spatial extent and distribution of scattered trees at a global scale. Due to the cost of high-resolution satellite imagery, global monitoring systems rely on medium-resolution satellites to monitor land use. Here we present a globally consistent method to identify trees with canopy diameters greater than three me…
ETH Zürich（苏黎世联邦理工学院）；Yale University（耶鲁大学）；University of Zurich（苏黎世大学）
The worldwide variation in vegetation height is fundamental to the global carbon cycle and central to the functioning of ecosystems and their biodiversity. Geospatially explicit and, ideally, highly resolved information is required to manage terrestrial ecosystems, mitigate climate change, and prevent biodiversity loss. Here, we present the first global, wall-to-wall canopy height map at 10 m ground sampling distance for the year 2020. No single data source meets these requirements: dedicated space missions like GEDI deliver sparse height data, with unprecedented coverage, whereas optical sate…
Deep Learning for automated multi-scale functional field boundaries extraction using multi-date Sentinel-2 and PlanetScope imagery: Case Study of Netherlands and Pakistan
Deep learning-based object detection of offshore platforms on Sentinel-1 Imagery and the impact of synthetic training data
German Remote Sensing Data Center, Earth Observation Center, EOC of the German Aerospace Center, DLR（德国遥感数据中心，地球观测中心，德国航空航天中心（DLR）东部观测中心）；Institute for Geography and Geology, Department of Remote Sensing, University of Würzburg（地理与地质研究所，遥感系，乌尔姆大学）
University College London（伦敦大学学院）；ESRIN（欧洲空间研究所）；World Food Programme（世界粮食计划署）
We introduce a novel neural network architecture -- Spectral ENcoder for SEnsor Independence (SEnSeI) -- by which several multispectral instruments, each with different combinations of spectral bands, can be used to train a generalised deep learning model. We focus on the problem of cloud masking, using several pre-existing datasets, and a new, freely available dataset for Sentinel-2. Our model is shown to achieve state-of-the-art performance on the satellites it was trained on (Sentinel-2 and Landsat 8), and is able to extrapolate to sensors it has not seen during training such as Landsat 7, …
Better Planet Laboratory, University of Colorado Boulder（科罗拉多大学博尔德分校更好星球实验室）；University of Colorado Boulder（科罗拉多大学博尔德分校）；Mortenson Center for Global Engineering and Resilience, University of Colorado Boulder（科罗拉多大学博尔德分校莫滕森全球工程与复原力中心）
Predicting Crop Yield With Machine Learning: An Extensive Analysis Of Input Modalities And Models On a Field and sub-field Level
University of Kaiserslautern-Landau (RPTU)（凯泽斯劳滕-兰道大学）；German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心）；Vision Impulse GmbH（Vision Impulse 有限责任公司）
The abundance of gaps in satellite image time series often complicates the application of deep learning models such as convolutional neural networks for spatiotemporal modeling. Based on previous work in computer vision on image inpainting, this paper shows how three-dimensional spatiotemporal partial convolutions can be used as layers in neural networks to fill gaps in satellite image time series. To evaluate the approach, we apply a U-Net-like model on incomplete image time series of quasi-global carbon monoxide observations from the Sentinel-5P satellite. Prediction errors were comparable t…
Beyond Backscatter: InSAR coherence from detected SAR images
Department of Aerospace Engineering, University of the Bundeswehr Munich（联邦国防军 Munich航空航天工程系）；Microwaves and Radar Institute, German Aerospace Center (DLR)（德国航空航天中心 (DLR) 微波与雷达研究所）
University of St. Gallen（圣加仑大学）；Sociovestix Labs Ltd.（Sociovestix实验室有限公司）；ISS Inc.（ISS公司）
The major driver of global warming has been identified as the anthropogenic release of greenhouse gas (GHG) emissions from industrial activities. The quantitative monitoring of these emissions is mandatory to fully understand their effect on the Earth's climate and to enforce emission regulations on a large scale. In this work, we investigate the possibility to detect and quantify industrial smoke plumes from globally and freely available multi-band image data from ESA's Sentinel-2 satellites. Using a modified ResNet-50, we can detect smoke plumes of different sizes with an accuracy of 94.3%. …
University of Science and Technology of China（中国科学技术大学）；Peking University（北京大学）；Microsoft Research（微软研究院）
This paper introduces a novel method by reshuffling deep features (i.e., permuting the spacial locations of a feature map) of the style image for arbitrary style transfer. We theoretically prove that our new style loss based on reshuffle connects both global and local style losses respectively used by most parametric and non-parametric neural style transfer methods. This simple idea can effectively address the challenging issues in existing style transfer methods. On one hand, it can avoid distortions in local style patterns, and allow semantic-level transfer, compared with neural parametric m…
Wuhan University（武汉大学）；Collaborative Innovation Center of Geospatial Technology（地理空间技术协同创新中心）；Key Laboratory of Geographic Information System, Ministry of Education（教育部地理信息系统重点实验室）；China Land Surveying and Planning Institute（中国国土勘测规划院）
Cloud detection is an important preprocessing step for the precise application of optical satellite imagery. In this paper, we propose a deep learning based cloud detection method named multi-scale convolutional feature fusion (MSCFF) for remote sensing images of different sensors. In the network architecture of MSCFF, the symmetric encoder-decoder module, which provides both local and global context by densifying feature maps with trainable convolutional filter banks, is utilized to extract multi-scale and high-level spatial features. The feature maps of multiple scales are then up-sampled an…
We propose the onion-peel networks for video completion. Given a set of reference images and a target image with holes, our network fills the hole by referring the contents in the reference images. Our onion-peel network progressively fills the hole from the hole boundary enabling it to exploit richer contextual information for the missing regions every step. Given a sufficient number of recurrences, even a large hole can be inpainted successfully. To attend to the missing information visible in the reference images, we propose an asymmetric attention block that computes similarities between t…
