In this paper, a Multi-Scale Fully Convolutional Network (MSFCN) with multi-scale convolutional kernel is proposed to exploit discriminative representations from two-dimensional (2D) satellite images.
Beijing Forestry University(北京林业大学);Tsinghua University(清华大学);Chinese Institute for Brain Research (CIBR)(中国脑科学研究中心(CIBR))
Extracting cultivated land accurately from high-resolution remote images is a basic task for precision agriculture. This report introduces our solution to the iFLYTEK challenge 2021 cultivated land extraction from high-resolution remote sensing image. The challenge requires segmenting cultivated land objects in very high-resolution multispectral remote sensing images. We established a highly effective and efficient pipeline to solve this problem. We first divided the original images into small tiles and separately performed instance segmentation on each tile. We explored several instance segme…
The Ohio State University(俄亥俄州立大学);Michigan Technological University(密歇根理工大学)
As an important application in remote sensing, landcover classification remains one of the most challenging tasks in very-high-resolution (VHR) image analysis. As the rapidly increasing number of Deep Learning (DL) based landcover methods and training strategies are claimed to be the state-of-the-art, the already fragmented technical landscape of landcover mapping methods has been further complicated. Although there exists a plethora of literature review work attempting to guide researchers in making an informed choice of landcover mapping methods, the articles either focus on the review of ap…
School of Natural and Computational Sciences, Massey University(梅西大学自然与计算科学学院);Department of Informatics, University of Leicester(莱斯特大学信息学系)
Sea-land segmentation is an important process for many key applications in remote sensing. Proper operative sea-land segmentation for remote sensing images remains a challenging issue due to complex and diverse transition between sea and lands. Although several Convolutional Neural Networks (CNNs) have been developed for sea-land segmentation, the performance of these CNNs is far from the expected target. This paper presents a novel deep neural network structure for pixel-wise sea-land segmentation, a Residual Dense U-Net (RDU-Net), in complex and high-density remote sensing images. RDU-Net is…
Land-cover classification has long been a hot and difficult challenge in remote sensing community. With massive High-resolution Remote Sensing (HRS) images available, manually and automatically designed Convolutional Neural Networks (CNNs) have already shown their great latent capacity on HRS land-cover classification in recent years. Especially, the former can achieve better performance while the latter is able to generate lightweight architecture. Unfortunately, they both have shortcomings. On the one hand, because manual CNNs are almost proposed for natural image processing, it becomes very…
SRM TRP Engineering College(SRM TRP工程学院);University of Sannio(萨尼奥大学);GSSS Institute of Engineering and Technology for Women(GSSS女子工程技术学院)
Land use and land cover (LULC) classification using remote sensing imagery plays a vital role in many environment modeling and land use inventories. In this study, a hybrid feature optimization algorithm along with a deep learning classifier is proposed to improve the performance of LULC classification, helping to predict wildlife habitat, deteriorating environmental quality, haphazard, etc. LULC classification is assessed using Sat 4, Sat 6 and Eurosat datasets. After the selection of remote sensing images, normalization and histogram equalization methods are used to improve the quality of th…
RMAU-NET: A Residual-Multihead-Attention U-Net Architecture for Landslide Segmentation and Detection from Remote Sensing Images
Van Lang University(范兰大学);Austrian Institute of Technology(奥地利技术研究院);Troyes University(特鲁瓦大学);HCM University of Technology(胡志明技术大学);Ton Duc Thang University(-ton Duc Thang大学)
本文提出了一种基于残差多头注意力 U-Net 架构的端到端深度学习模型 RMAU-NET,利用遥感图像进行滑坡检测与分割,在多个基准数据集上取得了优异的 F1 和 mIoU 分数,证明了其在实际滑坡观测系统中的应用潜力。
Centre for Research-based Innovation Visual Intelligence(可视化研究型创新中心)
Multi-modality data is becoming readily available in remote sensing (RS) and can provide complementary information about the Earth's surface. Effective fusion of multi-modal information is thus important for various applications in RS, but also very challenging due to large domain differences, noise, and redundancies. There is a lack of effective and scalable fusion techniques for bridging multiple modality encoders and fully exploiting complementary information. To this end, we propose a new multi-modality network (MultiModNet) for land cover mapping of multi-modal remote sensing data based o…
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Detecting and masking cloud and cloud shadow from satellite remote sensing images is a pervasive problem in the remote sensing community. Accurate and efficient detection of cloud and cloud shadow is an essential step to harness the value of remotely sensed data for almost all downstream analysis. DeepMask, a new algorithm for cloud and cloud shadow detection in optical satellite remote sensing imagery, is proposed in this study. DeepMask utilizes ResNet, a deep convolutional neural network, for pixel-level cloud mask generation. The algorithm is trained and evaluated on the Landsat 8 Cloud Co…
Landcover classification and change detection using remote sensing and machine learning: a case study of Western Fiji
Transitional Artificial Intelligence Research Group, School of Mathematics and Statistics, UNSW Sydney(过渡人工智能研究组,数学与统计学学院,UNSW悉尼);School of Geosciences, University of Sydney(地质科学学院,悉尼大学)
We explore the use of convolutional neural networks for the semantic classification of remote sensing scenes. Two recently proposed architectures, CaffeNet and GoogLeNet, are adopted, with three different learning modalities. Besides conventional training from scratch, we resort to pre-trained networks that are only fine-tuned on the target data, so as to avoid overfitting problems and reduce design time. Experiments on two remote sensing datasets, with markedly different characteristics, testify on the effectiveness and wide applicability of the proposed solution, which guarantees a significa…
Land-cover classification using remote sensing imagery is an important Earth observation task. Recently, land cover classification has benefited from the development of fully connected neural networks for semantic segmentation. The benchmark datasets available for training deep segmentation models in remote sensing imagery tend to be small, however, often consisting of only a handful of images from a single location with a single scale. This limits the models' ability to generalize to other datasets. Domain adaptation has been proposed to improve the models' generalization but we find these ap…
Estimating forest carbon stocks from high-resolution remote sensing imagery by reducing domain shift with style transfer
School of Geography and Remote Sensing, Guangzhou University(广州大学地理与遥感学院);Innovation Center for Remote Sensing Big Data Intelligent Applications, Guangzhou University(广州大学遥感大数据智能应用创新中心)
Sustainability of the global environment is dependent on the accurate land cover information over large areas. Even with the increased number of satellite systems and sensors acquiring data with improved spectral, spatial, radiometric and temporal characteristics and the new data distribution policy, most existing land cover datasets were derived from a pixel-based single-date multi-spectral remotely sensed image with low accuracy. To improve the accuracy, the bottleneck is how to develop an accurate and effective image classification technique. By incorporating and utilizing the complete mult…
Deep learning approaches have shown promising results in remote sensing high spatial resolution (HSR) land-cover mapping. However, urban and rural scenes can show completely different geographical landscapes, and the inadequate generalizability of these algorithms hinders city-level or national-level mapping. Most of the existing HSR land-cover datasets mainly promote the research of learning semantic representation, thereby ignoring the model transferability. In this paper, we introduce the Land-cOVEr Domain Adaptive semantic segmentation (LoveDA) dataset to advance semantic and transferable …
A Deep-Learning Framework for Land-Sliding Classification from Remote Sensing Image
University of technology of Troyes(特鲁瓦技术大学);ICC Dong Duong(东杜ong研究所);Biosel AI(Biosel人工智能公司);University of Technology Sydney(悉尼技术大学);Austrian Institute of Technology(奥地利技术研究所);Ho Chi Minh City University of Technology (HCMUT)(胡志明市技术大学)
University of Campinas(坎皮纳斯州立大学);Wageningen University & Research(瓦赫宁根大学及研究中心)
OpenStreetMap (OSM) is a community-based, freely available, editable map service that was created as an alternative to authoritative ones. Given that it is edited mainly by volunteers with different mapping skills, the completeness and quality of its annotations are heterogeneous across different geographical locations. Despite that, OSM has been widely used in several applications in {Geosciences}, Earth Observation and environmental sciences. In this work, we present a review of recent methods based on machine learning to improve and use OSM data. Such methods aim either 1) at improving the …
Landslide Detection and Segmentation Using Remote Sensing Images and Deep Neural Network
Austrian Institute of Technology(奥地利技术研究院);GeoSphere Austria(奥地利地球物理、气象和地球物理研究所);University of Natural Resources and Life Sciences, Vienna(维也纳自然资源与生命科学大学)
In present days remote sensing is most used application in many sectors. This remote sensing uses different images like multispectral, hyper spectral or ultra spectral. The remote sensing image classification is one of the significant method to classify image. In this state we classify the maximum likelihood classification with fuzzy logic. In this we experimenting fuzzy logic like spatial, spectral texture methods in that different sub methods to be used for image classification.
Wuhan University(武汉大学);Chinese Academy of Sciences(中国科学院);China Land Survey and Planning Institute(中国国土勘测规划院)
In recent years, large amount of high spatial-resolution remote sensing (HRRS) images are available for land-cover mapping. However, due to the complex information brought by the increased spatial resolution and the data disturbances caused by different conditions of image acquisition, it is often difficult to find an efficient method for achieving accurate land-cover classification with high-resolution and heterogeneous remote sensing images. In this paper, we propose a scheme to apply deep model obtained from labeled land-cover dataset to classify unlabeled HRRS images. The main idea is to r…
UniDiff: Parameter-Efficient Adaptation of Diffusion Models for Land Cover Classification with Multi-Modal Remotely Sensed Imagery and Sparse Annotations
Satellite remote imaging enables the detailed study of land use patterns on a global scale. We investigate the possibility to improve the information content of traditional land use classification by identifying the nature of industrial sites from medium-resolution remote sensing images. In this work, we focus on classifying different types of power plants from Sentinel-2 imaging data. Using a ResNet-50 deep learning model, we are able to achieve a mean accuracy of 90.0% in distinguishing 10 different power plant types and a background class. Furthermore, we are able to identify the cooling me…
Global-Local Contextual Progressive Expansion Network for Martian Landslide Segmentation in Multimodal Remote Sensing Imagery
Computer Vision Center, Universitat Autònoma de Barcelona(巴塞罗那自治大学计算机视觉中心);Fairfield University(费尔菲尔德大学);Michigan Technological University(密歇根理工大学);University of Kerala(喀拉拉大学);ESPOL Polytechnic University(ESPOL理工大学);University of Mississippi(密西西比大学)
Anna University(安娜大学);Akshya College Of Engineering And Technology(阿克沙亚工程与技术学院)
Maps are used to describe far-off places . It is an aid for navigation and military strategies. Mapping of the lands are important and the mapping work is based on (i). Natural resource management & development (ii). Information technology ,(iii). Environmental development ,(iv). Facility management and (v). e-governance. The Landuse / Landcover system espoused by almost all Organisations and scientists, engineers and remote sensing community who are involved in mapping of earth surface features, is a system which is derived from the united States Geological Survey (USGS) LULC classification s…
Remote sensing techniques are widely used for land cover classification and urban analysis. The availability of high resolution remote sensing imagery limits the level of classification accuracy attainable from pixel-based approach. In this paper object-based classification scheme based on a hierarchical support vector machine is introduced. By combining spatial and spectral information, the amount of overlap between classes can be decreased; thereby yielding higher classification accuracy and more accurate land cover maps. We have adopted certain automatic approaches based on the advanced tec…
An Iterative Classification and Semantic Segmentation Network for Old Landslide Detection Using High-Resolution Remote Sensing Images
Beijing University of Posts and Telecommunications(北京邮电大学);Beijing Institute of Technology(北京理工大学);China Aero Geophysical Survey and Remote Sensing Center for Natural Resources(中国自然资源航空物探遥感中心);La Trobe University(乐卓博大学)
In this study, a novel machine learning algorithm is presented for disaggregation of satellite soil moisture (SM) based on self-regularized regressive models (SRRM) using high-resolution correlated information from auxiliary sources. It includes regularized clustering that assigns soft memberships to each pixel at fine-scale followed by a kernel regression that computes the value of the desired variable at all pixels. Coarse-scale remotely sensed SM were disaggregated from 10km to 1km using land cover, precipitation, land surface temperature, leaf area index, and in-situ observations of SM. Th…
Hubei University of Technology(湖北工业大学);Wuhan University(武汉大学)
Land cover classification is a multi-class segmentation task to classify each pixel into a certain natural or man-made category of the earth surface, such as water, soil, natural vegetation, crops, and human infrastructure. Limited by hardware computational resources and memory capacity, most existing studies preprocessed original remote sensing images by down sampling or cropping them into small patches less than 512*512 pixels before sending them to a deep neural network. However, down sampling images incurs spatial detail loss, renders small segments hard to discriminate, and reverses the s…
With the advancement of remote-sensed imaging large volumes of very high resolution land cover images can now be obtained. Automation of object recognition in these 2D images, however, is still a key issue. High intra-class variance and low inter-class variance in Very High Resolution (VHR) images hamper the accuracy of prediction in object recognition tasks. Most successful techniques in various computer vision tasks recently are based on deep supervised learning. In this work, a deep Convolutional Neural Network (CNN) based on symmetric encoder-decoder architecture with skip connections is e…
SPEX: A Vision-Language Model for Land Cover Extraction on Spectral Remote Sensing Images
College of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);iFlytek Co., Ltd.(iFlytek公司);National Engineering Research Center of Speech and Language Information Processing(语音与语言信息处理国家工程研究中心);School of Computer Science, Wuhan University(武汉大学计算机学院);Zhongguancun Academy(中关村学院);National Engineering Research Center for Multimedia Software(多媒体软件国家工程研究中心);Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University(湖北省多媒体与网络通信工程重点实验室,武汉大学);State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(测绘遥感信息工程国家重点实验室,武汉大学)
Remote Sensing Technology Institute, German Aerospace Center(德国航空航天中心遥感技术研究所);Technical University of Munich(慕尼黑工业大学);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);INRIA(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔理工学院)
As remote sensing (RS) data obtained from different sensors become available largely and openly, multimodal data processing and analysis techniques have been garnering increasing interest in the RS and geoscience community. However, due to the gap between different modalities in terms of imaging sensors, resolutions, and contents, embedding their complementary information into a consistent, compact, accurate, and discriminative representation, to a great extent, remains challenging. To this end, we propose a shared and specific feature learning (S2FL) model. S2FL is capable of decomposing mult…
Many significant applications need land cover information of remote sensing images that are acquired from different areas and times, such as change detection and disaster monitoring. However, it is difficult to find a generic land cover classification scheme for different remote sensing images due to the spectral shift caused by diverse acquisition condition. In this paper, we develop a novel land cover classification method that can deal with large-scale data captured from widely distributed areas and different times. Additionally, we establish a large-scale land cover classification dataset …
Modeling forests using historical data allows for more accurately evolution analysis, thus providing an important basis for other studies. As a recognized and effective tool, remote sensing plays an important role in forestry analysis. We can use it to derive information about the forest, including tree type, coverage and canopy density. There are many forest time series modeling studies using statistic values, but few using remote sensing images. Image prediction digital twin is an implementation of digital twin, which aims to predict future images bases on historical data. In this paper, we …
Accubits Technologies Inc(Accubits科技公司);Acharya Narendra Dev College, University of Delhi(德里大学阿查里雅·纳伦德拉·德夫学院);University of Calgary(卡尔加里大学)
Efficiently implementing remote sensing image classification with high spatial resolution imagery can provide a significant value in Land Use and Land Cover (LULC) classification. The new advances in remote sensing and deep learning technologies have facilitated the extraction of spatiotemporal information for LULC classification. Moreover, the diverse disciplines of science, including remote sensing, have utilised tremendous improvements in image classification by Convolutional Neural Networks (CNNs) with transfer learning. In this study, instead of training CNNs from scratch, the transfer le…
Shenzhen Institutes of Advanced Technology, CAS(中国科学院深圳先进技术研究院);Beijing Futong Dongfang Technology Co, Ltd(北京富通东方科技有限公司);Beijing University of Chemical Technology(北京化工大学)
Robust semantic segmentation of VHR remote sensing images from UAV sensors is critical for earth observation, land use, land cover or mapping applications. Several factors such as shadows, weather disruption and camera shakes making this problem highly challenging, especially only using RGB images. In this paper, we propose the use of multi-modality data including NIR, RGB and DSM to increase robustness of segmentation in blurred or partially damaged VHR remote sensing images. By proposing a cascaded dense encoder-decoder network and the SELayer based fusion and assembling techniques, the prop…
University of Kentucky(肯塔基大学);Indiana University Bloomington(印第安纳大学伯明顿分校)
We propose a novel convolutional neural network architecture for estimating geospatial functions such as population density, land cover, or land use. In our approach, we combine overhead and ground-level images in an end-to-end trainable neural network, which uses kernel regression and density estimation to convert features extracted from the ground-level images into a dense feature map. The output of this network is a dense estimate of the geospatial function in the form of a pixel-level labeling of the overhead image. To evaluate our approach, we created a large dataset of overhead and groun…
MMLSv2: A Multimodal Dataset for Martian Landslide Detection in Remote Sensing Imagery
Fairfield University(费尔菲尔德大学);Michigan Technological University(密歇根技术大学);Computer Vision Center(计算机视觉中心);Universitat Autònoma de Barcelona(巴塞罗那自治大学);ESPOL Polytechnic University(ESPOL多科大学);University of Kerala(喀拉拉大学);University of Mississippi(密西西比大学)
Building coverage statistics provide crucial insights into the urbanization, infrastructure, and poverty level of a region, facilitating efforts towards alleviating poverty, building sustainable cities, and allocating infrastructure investments and public service provision. Global mapping of buildings has been made more efficient with the incorporation of deep learning models into the pipeline. However, these models typically rely on high-resolution satellite imagery which are expensive to collect and infrequently updated. As a result, building coverage data are not updated timely especially i…
Changes to Captions: An Attentive Network for Remote Sensing Change Captioning
Institute of Advanced Research in Artificial Intelligence(人工智能高级研究院);Helmholtz-Zentrum Dresden-Rossendorf (HZDR)(亥姆霍兹德累斯顿罗森多夫研究中心);Helmholtz Institute Freiberg for Resource Technology (HIF)(亥姆霍兹弗赖贝格资源技术研究所)
School of Artificial Intelligence, Xidian University(西安电子科技大学人工智能学院);MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University(上海交通大学人工智能研究院)
The production of thematic maps depicting land cover is one of the most common applications of remote sensing. To this end, several semantic segmentation approaches, based on deep learning, have been proposed in the literature, but land cover segmentation is still considered an open problem due to some specific problems related to remote sensing imaging. In this paper we propose a novel approach to deal with the problem of modelling multiscale contexts surrounding pixels of different land cover categories. The approach leverages the computation of a heteroscedastic measure of uncertainty when …
Guangdong Key Laboratory for Urbanization and Geo-simulation, Sun Yat-sen University(中山大学广东省城市化与地理模拟重点实验室)
With the rapid progress of China's urbanization, research on the automatic detection of land-use patterns in Chinese cities is of substantial importance. Deep learning is an effective method to extract image features. To take advantage of the deep-learning method in detecting urban land-use patterns, we applied a transfer-learning-based remote-sensing image approach to extract and classify features. Using the Google Tensorflow framework, a powerful convolution neural network (CNN) library was created. First, the transferred model was previously trained on ImageNet, one of the largest object-im…
Istituto Nazionale di Fisica Nucleare(意大利国家核物理研究所);Università Milano−Bicocca(米兰比可卡大学)
In this paper, we propose an unsupervised method for hyperspectral remote sensing image segmentation. The method exploits the mean-shift clustering algorithm that takes as input a preliminary hyperspectral superpixels segmentation together with the spectral pixel information. The proposed method does not require the number of segmentation classes as input parameter, and it does not exploit any a-priori knowledge about the type of land-cover or land-use to be segmented (e.g. water, vegetation, building etc.). Experiments on Salinas, SalinasA, Pavia Center and Pavia University datasets are carri…
Adaptive Frequency Enhancement Network for Remote Sensing Image Semantic Segmentation
School of Computer Science and Technology, Ocean University of China(中国海洋大学计算机科学与技术学院);Department of Electrical and Computer Engineering, Mississippi State University(密西西比州立大学电气与计算机工程系)