Landsat-8 (NASA) and Sentinel-2 (ESA) are two prominent multi-spectral imaging satellite projects that provide publicly available data. The multi-spectral imaging sensors of the satellites capture images of the earth's surface in the visible and infrared region of the electromagnetic spectrum. Since the majority of the earth's surface is constantly covered with clouds, which are not transparent at these wavelengths, many images do not provide much information. To increase the temporal availability of cloud-free images of a certain area, one can combine the observations from multiple sources. However, the sensors of satellites might differ in their properties, making the images incompatible. This work provides a first glance at the possibility of using a transformer-based model to reduce the spectral and spatial differences between observations from both satellite projects. We compare the results to a model based on a fully convolutional UNet architecture. Somewhat surprisingly, we find that, while deep models outperform classical approaches, the UNet significantly outperforms the transformer in our experiments.
University of Winnipeg（温尼伯大学）；Norwegian University of Science & Technology (NTNU) Gjøvik（挪威科技大学（NTNU）约维克校区）
The availability of frequent and cost-free satellite images is in growing demand in the research world. Such satellite constellations as Landsat 8 and Sentinel-2 provide a massive amount of valuable data daily. However, the discrepancy in the sensors' characteristics of these satellites makes it senseless to use a segmentation model trained on either dataset and applied to another, which is why domain adaptation techniques have recently become an active research area in remote sensing. In this paper, an experiment of domain adaptation through style-transferring is conducted using the HRSemI2I …
GFZ German Research Centre for Geosciences（德国地学研究中心）；Universitat de València（瓦伦西亚大学）；University of Twente（特文特大学）；Nanjing University（南京大学）
Satellite remote sensing has been widely used in the last decades for agricultural applications, {both for assessing vegetation condition and for subsequent yield prediction.} Existing remote sensing-based methods to estimate gross primary productivity (GPP), which is an important variable to indicate crop photosynthetic function and stress, typically rely on empirical or semi-empirical approaches, which tend to over-simplify photosynthetic mechanisms. In this work, we take advantage of all parallel developments in mechanistic photosynthesis modeling and satellite data availability for advance…
Improved flood mapping for efficient policy design by fusion of Sentinel-1, Sentinel-2, and Landsat-9 imagery to identify population and infrastructure exposed to floods
Lahore University of Management Sciences (LUMS)（拉合尔管理科学大学（LUMS））
HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Dates
Geospatial Sciences Center of Excellence, Department of Geography and Geospatial Sciences, South Dakota State University（地理科学卓越中心，地理与空间科学系，南达科他州立大学）；Department of Geography, Environment, and Spatial Sciences, & Center for Global Change and Earth Observations, Michigan State University（地理、环境与空间科学系，以及全球变化与地球观测中心，密歇根州立大学）
This paper presents an aligned multi-temporal and multi-resolution satellite image dataset for research in change detection. We expect our dataset to be useful to researchers who want to fuse information from multiple satellites for detecting changes on the surface of the earth that may not be fully visible in any single satellite. The dataset we present was created by augmenting the SpaceNet-7 dataset with temporally parallel stacks of Landsat and Sentinel images. The SpaceNet-7 dataset consists of time-sequenced Planet images recorded over 101 AOIs (Areas-of-Interest). In our dataset, for ea…
The estimation of deforestation in the Amazon Forest is challenge task because of the vast size of the area and the difficulty of direct human access. However, it is a crucial problem in that deforestation results in serious environmental problems such as global climate change, reduced biodiversity, etc. In order to effectively solve the problems, satellite imagery would be a good alternative to estimate the deforestation of the Amazon. With a combination of optical images and Synthetic aperture radar (SAR) images, observation of such a massive area regardless of weather conditions become poss…
Many earth observation programs such as Landsat, Sentinel, SPOT, and Pleiades produce huge volume of medium to high resolution multi-spectral images every day that can be organized in time series. In this work, we exploit both temporal and spatial information provided by these images to generate land cover maps. For this purpose, we combine a fully convolutional neural network with a convolutional long short-term memory. Implementation details of the proposed spatio-temporal neural network architecture are provided. Experimental results show that the temporal information provided by time serie…
University College London（伦敦大学学院）；ESRIN（欧洲空间研究所）；World Food Programme（世界粮食计划署）
We introduce a novel neural network architecture -- Spectral ENcoder for SEnsor Independence (SEnSeI) -- by which several multispectral instruments, each with different combinations of spectral bands, can be used to train a generalised deep learning model. We focus on the problem of cloud masking, using several pre-existing datasets, and a new, freely available dataset for Sentinel-2. Our model is shown to achieve state-of-the-art performance on the satellites it was trained on (Sentinel-2 and Landsat 8), and is able to extrapolate to sensors it has not seen during training such as Landsat 7, …
SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining
Chair of Data Science in Earth Observation（地球观测数据科学主任）；Technical University of Munich（慕尼黑技术大学）；Remote Sensing Technology Institute（遥感技术研究所）；German Aerospace Center (DLR)（德国航空航天中心）；Department of Aerospace Engineering（航空航天工程系）；University of the Bundeswehr Munich（联邦国防军慕尼黑大学）；LEAP；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）；Univ. Grenoble Alpes（格勒诺布尔阿尔卑斯大学）；Inria（法国国家信息与自动化技术研究院）；CNRS（法国国家科学研究中心）；Grenoble INP（格勒诺布尔INP）；LJK
KP Labs（KP实验室）；Institute of Theoretical and Applied Informatics, Polish Academy of Sciences（波兰科学院理论与应用信息学研究所）；Silesian University of Technology（西里西亚工业大学）
Cloud detection is a pivotal satellite image pre-processing step that can be performed both on the ground and on board a satellite to tag useful images. In the latter case, it can help to reduce the amount of data to downlink by pruning the cloudy areas, or to make a satellite more autonomous through data-driven acquisition re-scheduling of the cloudy areas. We approach this important task with nnU-Nets, a self-reconfigurable framework able to perform meta-learning of a segmentation network over various datasets. Our experiments, performed over Sentinel-2 and Landsat-8 multispectral images rev…
The UN Sustainable Development Goals allude to the importance of infrastructure quality in three of its seventeen goals. However, monitoring infrastructure quality in developing regions remains prohibitively expensive and impedes efforts to measure progress toward these goals. To this end, we investigate the use of widely available remote sensing data for the prediction of infrastructure quality in Africa. We train a convolutional neural network to predict ground truth labels from the Afrobarometer Round 6 survey using Landsat 8 and Sentinel 1 satellite imagery. Our best models predict infrast…
An Integrated Framework for the Heterogeneous Spatio-Spectral-Temporal Fusion of Remote Sensing Images
School of Resource and Environmental Science, Wuhan University（武汉大学资源与环境科学学院）；School of Geodesy and Geomatics, Wuhan University（武汉大学测绘学院）；Collaborative Innovation Center of Geospatial Technology, Wuhan University（武汉大学地球空间信息技术协同创新中心）；State Key Laboratory of Information Engineering, Survey Mapping and Remote Sensing, Wuhan University（武汉大学测绘遥感信息工程国家重点实验室）
ReflectGAN: Modeling Vegetation Effects for Soil Carbon Estimation from Satellite Imagery
School of Computing, Mathematics, and Engineering, Charles Sturt University（计算机科学与工程学院，查尔斯·斯特劳特大学）；Cooperative Research Centre for High Performance Soils（高性能土壤联合研究中心）；School of Information Technology, Deakin University（信息科技学院，德金大学）；Institute of Innovation, Science and Sustainability, Federation University（创新、科学与可持续性研究所，联邦大学）；Gulbali Institute, Charles Sturt University（古尔巴利研究所，查尔斯·斯特劳特大学）
A multi-temporal multi-spectral attention-augmented deep convolution neural network with contrastive learning for crop yield prediction
Department of Computer Science and Engineering, Indian Institute of Technology (IIT) Indore, Indore 453552, India（计算机科学与工程系，印度理工学院（IIT）印多尔，印多尔453552，印度）
Improving Satellite Imagery Masking using Multi-task and Transfer Learning
College of Information and Computer Sciences, University of Massachusetts（马萨诸塞大学信息与计算机科学学院）；University of Pittsburgh（匹兹堡大学）；University of North Carolina（北卡罗来纳大学）
Wuhan University（武汉大学）；Collaborative Innovation Center of Geospatial Technology（地理空间技术协同创新中心）；Key Laboratory of Geographic Information System, Ministry of Education（教育部地理信息系统重点实验室）；China Land Surveying and Planning Institute（中国国土勘测规划院）
Cloud detection is an important preprocessing step for the precise application of optical satellite imagery. In this paper, we propose a deep learning based cloud detection method named multi-scale convolutional feature fusion (MSCFF) for remote sensing images of different sensors. In the network architecture of MSCFF, the symmetric encoder-decoder module, which provides both local and global context by densifying feature maps with trainable convolutional filter banks, is utilized to extract multi-scale and high-level spatial features. The feature maps of multiple scales are then up-sampled an…
