To benefit the complementary information between heterogeneous data, we introduce a new Multimodal Transformer (MMFormer) for Remote Sensing (RS) image classification using Hyperspectral Image (HSI) accompanied by another source of data such as Light Detection and Ranging (LiDAR). Compared with traditional Vision Transformer (ViT) lacking inductive biases of convolutions, we first introduce convolutional layers to our MMFormer to tokenize patches from multimodal data of HSI and LiDAR. Then we propose a Multi-scale Multi-head Self-Attention (MSMHSA) module to address the problem of compatibility which often limits to fuse HSI with high spectral resolution and LiDAR with relatively low spatial resolution. The proposed MSMHSA module can incorporate HSI to LiDAR data in a coarse-to-fine manner enabling us to learn a fine-grained representation. Extensive experiments on widely used benchmarks (e.g., Trento and MUUFL) demonstrate the effectiveness and superiority of our proposed MMFormer for RS image classification.
Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院）；University of Chinese Academy of Sciences（中国科学院大学）
Remote sensing (RS) cross-modal text-image retrieval has attracted extensive attention for its advantages of flexible input and efficient query. However, traditional methods ignore the characteristics of multi-scale and redundant targets in RS image, leading to the degradation of retrieval accuracy. To cope with the problem of multi-scale scarcity and target redundancy in RS multimodal retrieval task, we come up with a novel asymmetric multimodal feature matching network (AMFMN). Our model adapts to multi-scale feature inputs, favors multi-source retrieval methods, and can dynamically filter r…
The problem of effectively exploiting the information multiple data sources has become a relevant but challenging research topic in remote sensing. In this paper, we propose a new approach to exploit the complementarity of two data sources: hyperspectral images (HSIs) and light detection and ranging (LiDAR) data. Specifically, we develop a new dual-channel spatial, spectral and multiscale attention convolutional long short-term memory neural network (called dual-channel A3CLNN) for feature extraction and classification of multisource remote sensing data. Spatial, spectral and multiscale attent…
College of Electronics and Information Engineering, Sichuan University（四川大学电子信息工程学院）；School of Mechanical Engineering and Automation, Fuzhou University（福州大学机械工程与自动化学院）；Yunnan Key Laboratory of Software Engineering, Yunnan University（云南大学云南省软件工程重点实验室）
Change detection (CD) in remote sensing images has been an ever-expanding area of research. To date, although many methods have been proposed using various techniques, accurately identifying changes is still a great challenge, especially in the high resolution or heterogeneous situations, due to the difficulties in effectively modeling the features from ground objects with different patterns. In this paper, a novel CD method based on the graph convolutional network (GCN) and multiscale object-based technique is proposed for both homogeneous and heterogeneous images. First, the object-wise high…
An ideal fusion method preserves the Spectral information in fused image and adds spatial information to it with no spectral distortion. Recently wavelet kalman filter method is proposed which uses ARSIS concept to fuses MS and PAN images. This method is applied in a multiscale version, i.e. the variable index is scale instead of time. With the aim of fusion we present a more detailed study on this model and discuss about rationality of its assumptions such as first order markov model and Gaussian distribution of the posterior density. Finally, we propose a method using wavelet Kalman Particle…
URoadNet: Dual Sparse Attentive U-Net for Multiscale Road Network Extraction
College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications（南京邮电大学自动化学院与人工智能学院）；School of Computer Science and Engineering, Nanjing University of Science and Technology（南京理工大学计算机科学与工程学院）；Jarvis Research Center, Tencent YouTu Lab（腾讯优图实验室贾维斯研究中心）
The production of thematic maps depicting land cover is one of the most common applications of remote sensing. To this end, several semantic segmentation approaches, based on deep learning, have been proposed in the literature, but land cover segmentation is still considered an open problem due to some specific problems related to remote sensing imaging. In this paper we propose a novel approach to deal with the problem of modelling multiscale contexts surrounding pixels of different land cover categories. The approach leverages the computation of a heteroscedastic measure of uncertainty when …
ChangeDINO: DINOv3-Driven Building Change Detection in Optical Remote Sensing Imagery
1 Inst.\ of Data Science, National Cheng Kung University, \ , Taiwan - 2 Inst.\ of Intelligent Systems College of Artificial Intelligence, \ Yang Ming Chiao Tung University, Hsinchu, Taiwan
The very high spatial resolution (VHR) remote sensing images have been an extremely valuable source for monitoring changes occurred on the earth surface. However, precisely detecting relevant changes in VHR images still remains a challenge, due to the complexity of the relationships among ground objects. To address this limitation, a dual neighborhood hypergraph neural network is proposed in this article, which combines the multiscale superpixel segmentation and hypergraph convolution to model and exploit the complex relationships. First, the bi-temporal image pairs are segmented under two sca…
L-UNet: An LSTM Network for Remote Sensing Image Change Detection
College of Life Sciences and Oceanography, Shenzhen University（深圳大学生命科学与海洋学院）；School of Computer Science, China University of Geosciences（中国地质大学（武汉）计算机学院）
Decomposition-based Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）理工学院）；School of Information Science and Engineering, Wuhan University of Science and Technology（武汉科技大学信息科学与工程学院）；School of Cyber Science and Engineering, Wuhan University（武汉大学网络空间安全学院）；School of Electronic Engineering and Computer Science, Peking University（北京大学电子工程与计算机科学学院）
SPEX: A Vision-Language Model for Land Cover Extraction on Spectral Remote Sensing Images
College of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院）；iFlytek Co., Ltd.（iFlytek公司）；National Engineering Research Center of Speech and Language Information Processing（语音与语言信息处理国家工程研究中心）；School of Computer Science, Wuhan University（武汉大学计算机学院）；Zhongguancun Academy（中关村学院）；National Engineering Research Center for Multimedia Software（多媒体软件国家工程研究中心）；Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University（湖北省多媒体与网络通信工程重点实验室，武汉大学）；State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University（测绘遥感信息工程国家重点实验室，武汉大学）
MaskCD: A Remote Sensing Change Detection Network Based on Mask Classification
Helmholtz Institute Freiberg for Resource Technology（弗莱贝格亥姆霍兹资源技术研究所）；Helmholtz-Zentrum Dresden-Rossendorf（德累斯顿-罗森多夫亥姆霍兹中心）；Technical University of Munich (TUM)（慕尼黑工业大学）；School of Information Science and Engineering, Wuhan University of Science and Technology（武汉科技大学信息科学与工程学院）；School of Engineering, Shiv Nadar University（希夫·纳达尔大学工程学院）；Munich Center for Machine Learning（慕尼黑机器学习中心）；Lancaster University（兰卡斯特大学）
IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classification
Nanjing University of Information Science and Technology（南京信息工程大学）；Institute of Optics and Electronics（光学电子研究所）；China University of Geosciences（中国地质大学）；University of Extremadura（埃斯特雷马杜拉大学）
P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentation
School of Information Science and Technology, Northwest University（西北大学信息科学与技术学院）；School of Art and Media, Beijing Normal University（北京师范大学艺术与传媒学院）；School of Management, Nanjing Police University（南京警察学院管理学院）
Temporally Ordered Region-Token Mamba with Logit-Space Diffusion for Remote Sensing Change Detection
Georgia Institute of Technology（佐治亚理工学院）；Indian Institute of Engineering Science and Technology (IIEST), Shibpur（印度工程科学与技术学院（IIEST），希布普尔）；Nanyang Technological University（南洋理工大学）；Indian Institute of Technology, Delhi（印度理工学院德里分校）；Duke University（杜克大学）
LCD-Net: A Lightweight Remote Sensing Change Detection Network Combining Feature Fusion and Gating Mechanism
School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture（北京建筑大学电气与信息工程学院）；School of Artificial Intelligence, Jilin University（吉林大学人工智能学院）
Information transmission: Inferring change area from change moment in time series remote sensing images
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University（武汉大学测绘遥感信息工程国家重点实验室）；School of Geography and Planning, Sun Yat-sen University（中山大学地理科学与规划学院）
Norwegian Computing Center（挪威计算中心）；UiT the Arctic University of Norway（挪威北极大学）
Land cover classification of remote sensing images is a challenging task due to limited amounts of annotated data, highly imbalanced classes, frequent incorrect pixel-level annotations, and an inherent complexity in the semantic segmentation task. In this article, we propose a novel architecture called the dense dilated convolutions' merging network (DDCM-Net) to address this task. The proposed DDCM-Net consists of dense dilated image convolutions merged with varying dilation rates. This effectively utilizes rich combinations of dilated convolutions that enlarge the network's receptive fields …
Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences（中国科学院遥感与数字地球研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Tandon School of Engineering, New York University（纽约大学坦登工程学院）
Point cloud classification plays an important role in a wide range of airborne light detection and ranging (LiDAR) applications, such as topographic mapping, forest monitoring, power line detection, and road detection. However, due to the sensor noise, high redundancy, incompleteness, and complexity of airborne LiDAR systems, point cloud classification is challenging. In this paper, we proposed a directionally constrained fully convolutional neural network (D-FCN) that can take the original 3D coordinates and LiDAR intensity as input; thus, it can directly apply to unstructured 3D point clouds…
The Graduate Center, City University of New York（纽约城市大学研究生中心）；Tufts University（塔夫茨大学）
Images captured in real-world applications in remote sensing, image or video retrieval, and outdoor surveillance suffer degraded quality introduced by poor weather conditions. Conditions such as rain and mist, introduce artifacts that make visual analysis challenging and limit the performance of high-level computer vision methods. For time-critical applications where a rapid response is necessary, it becomes crucial to develop algorithms that automatically remove rain, without diminishing the quality of the image contents. This article aims to develop a novel quaternion multi-stage multiscale …
OSDM-MReg: Multimodal Image Registration based One Step Diffusion Model
Shanghai Key Laboratory of Intelligent Sensing and Recognition（上海智能感知与识别重点实验室）；Shanghai Jiao Tong University（上海交通大学）；Center of Digital Innovation（数字创新中心）
An Efficient Additive Kolmogorov-Arnold Transformer for Point-Level Maize Localization in Unmanned Aerial Vehicle Imagery
Department of Biological Systems Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA（生物系统工程系，威斯康星大学麦迪逊分校）；Department of Agronomy, University of Wisconsin-Madison, Madison, WI 53706, USA（农学系，威斯康星大学麦迪逊分校）
Enhancing Ship Classification in Optical Satellite Imagery: Integrating Convolutional Block Attention Module with ResNet for Improved Performance
Sungkyunkwan University School of Medicine（成均馆大学医学院）；The Coala Inc.（考拉公司）；Korea Science Academy of Korea Advanced Institute of Science and Technology（韩国科学技术院韩国科学学院）；Seoul National University School of Earth and Environmental Sciences（首尔国立大学地球与环境科学学院）
