School of Artificial Intelligence and School of Automation, Xi’an University of Posts and Telecommunications(人工智能学院和自动化学院,西安邮电大学);Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University(电气电子工程系,香港理工大学)
Remote sensing change detection (RSCD) aims to identify the spatio-temporal changes of land cover, providing critical support for multi-disciplinary applications (e.g., environmental monitoring, disaster assessment, and climate change studies). Existing methods focus either on extracting features from localized patches, or pursue processing entire images holistically, which leads to the cross temporal feature matching deviation and exhibiting sensitivity to radiometric and geometric noise. Following the above issues, we propose a dual-module collaboration guided hierarchical adaptive aggregation framework, namely HA2F, which consists of dynamic hierarchical feature calibration module (DHFCM) and noise-adaptive feature refinement module (NAFRM). The former dynamically fuses adjacent-level features through perceptual feature selection, suppressing irrelevant discrepancies to address multi-temporal feature alignment deviations. The NAFRM utilizes the dual feature selection mechanism to highlight the change sensitive regions and generate spatial masks, suppressing the interference of irrelevant regions or shadows. Extensive experiments verify the effectiveness of the proposed HA2F, which achieves state-of-the-art performance on LEVIR-CD, WHU-CD, and SYSU-CD datasets, surpassing existing comparative methods in terms of both precision metrics and computational efficiency. In addition, ablation experiments show that DHFCM and NAFRM are effective. \href{https://huggingface.co/InPeerReview/RemoteSensingChangeDetection-RSCD.HA2F}{HA2F Official Code is Available Here!}
Wuhan University(武汉大学);Lancaster University(兰卡斯特大学);UK Centre for Ecology and Hydrology(英国生态与水文中心)
Semantic segmentation using fine-resolution remotely sensed images plays a critical role in many practical applications, such as urban planning, environmental protection, natural and anthropogenic landscape monitoring, etc. However, the automation of semantic segmentation, i.e., automatic categorization/labeling and segmentation is still a challenging task, particularly for fine-resolution images with huge spatial and spectral complexity. Addressing such a problem represents an exciting research field, which paves the way for scene-level landscape pattern analysis and decision making. In this …
Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentation
University of Southampton(南安普顿大学);School of Computer Science, University of Sydney(悉尼大学计算机科学学院);School of Computing and Artificial Intelligence, Southwest Jiaotong University(西南交通大学计算机与人工智能学院)
Breaking the Box: Enhancing Remote Sensing Image Segmentation with Freehand Sketches
Huzhou University(湖州大学);Singapore University of Technology and Design(新加坡科技设计大学);University of Science and Technology of China(中国科学技术大学);Zhejiang University(浙江大学);KOKONI 3D, Moxin (Huzhou) Tech. Co., LTD.(墨芯(湖州)科技有限公司(KOKONI 3D))
Prototype-Based Pseudo-Label Denoising for Source-Free Domain Adaptation in Remote Sensing Semantic Segmentation
College of Computer Science, Sichuan University(四川大学计算机科学学院);College of Computer Science and Cyber Security, Chengdu University of Technology(成都理工大学计算机科学与网络安全学院)
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);University of Leicester(莱斯特大学)
Due to the more dramatic multi-scale variations and more complicated foregrounds and backgrounds in optical remote sensing images (RSIs), the salient object detection (SOD) for optical RSIs becomes a huge challenge. However, different from natural scene images (NSIs), the discussion on the optical RSI SOD task still remains scarce. In this paper, we propose a multi-scale context network, namely MSCNet, for SOD in optical RSIs. Specifically, a multi-scale context extraction module is adopted to address the scale variation of salient objects by effectively learning multi-scale contextual informa…
Wuhan University(武汉大学);Lancaster University(兰卡斯特大学);UK Centre for Ecology & Hydrology(英国生态与水文中心)
The fully convolutional network (FCN) with an encoder-decoder architecture has been the standard paradigm for semantic segmentation. The encoder-decoder architecture utilizes an encoder to capture multilevel feature maps, which are incorporated into the final prediction by a decoder. As the context is crucial for precise segmentation, tremendous effort has been made to extract such information in an intelligent fashion, including employing dilated/atrous convolutions or inserting attention modules. However, these endeavors are all based on the FCN architecture with ResNet or other backbones, w…
FedEU: Evidential Uncertainty-Driven Federated Fine-Tuning of Vision Foundation Models for Remote Sensing Image Segmentation
School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院);School of Information Science and Engineering, Wuhan University of Science and Technology(武汉科技大学信息科学与工程学院);School of Computer Science, Wuhan University(武汉大学计算机学院)
MSSFC-Net:Enhancing Building Interpretation with Multi-Scale Spatial-Spectral Feature Collaboration
National Demonstration Center for Experimental Electrical, Changchun University of Science and Technology(长春理工大学国家级电工电子实验教学示范中心);Jilin Province Zhixing IoT Research Institute Co.,Ltd.(吉林省智行物联网研究院有限公司);Beihang University(北京航空航天大学)
Beijing Institute of Technology(北京理工大学);University of Delaware(特拉华大学);The Aviation Industry Corporation of China, Ltd.(中国航空工业集团有限公司);Luoyang Institute of Electro-Optical Equipment(洛阳电光设备研究所)
A few lightweight convolutional neural network (CNN) models have been recently designed for remote sensing object detection (RSOD). However, most of them simply replace vanilla convolutions with stacked separable convolutions, which may not be efficient due to a lot of precision losses and may not be able to detect oriented bounding boxes (OBB). Also, the existing OBB detection methods are difficult to constrain the shape of objects predicted by CNNs accurately. In this paper, we propose an effective lightweight oriented object detector (LO-Det). Specifically, a channel separation-aggregation …
CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation
College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息与电子工程学院);School of Aeronautics and Astronautics, Zhejiang University(浙江大学航空航天学院);College of Computer Science, Zhejiang University(浙江大学计算机学院)
Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentation
School of Electronics and Information Engineering, Harbin Institute of Technology(电子信息工程学院,哈尔滨工业大学);Faculty of Computing, Harbin Institute of Technology(计算机学院,哈尔滨工业大学);Peng Cheng Laboratory, Shenzhen(鹏城实验室,深圳)
We propose in this article to build up a collaboration between a deep neural network and a human in the loop to swiftly obtain accurate segmentation maps of remote sensing images. In a nutshell, the agent iteratively interacts with the network to correct its initially flawed predictions. Concretely, these interactions are annotations representing the semantic labels. Our methodological contribution is twofold. First, we propose two interactive learning schemes to integrate user inputs into deep neural networks. The first one concatenates the annotations with the other network's inputs. The sec…
School of Information and Artificial Intelligence, Yunnan University of Finance and Economics(云南财经大学信息与人工智能学院);Department of Computer Science, Hong Kong Baptist University(香港浸会大学计算机科学系);School of Electronics and Information, Northwestern Polytechnical University(西北工业大学电子信息学院)
TU Kaiserslautern(凯泽斯劳滕工业大学);German Research Center for Artificial Intelligence(德国人工智能研究中心)
Remote collaboration systems have become increasingly important in today's society, especially during times where physical distancing is advised. Industry, research and individuals face the challenging task of collaborating and networking over long distances. While video and teleconferencing are already widespread, collaboration systems in augmented, virtual, and mixed reality are still a niche technology. We provide an overview of recent developments of synchronous remote collaboration systems and create a taxonomy by dividing them into three main components that form such systems: Environmen…
Though semantic segmentation has been heavily explored in vision literature, unique challenges remain in the remote sensing domain. One such challenge is how to handle resolution mismatch between overhead imagery and ground-truth label sources, due to differences in ground sample distance. To illustrate this problem, we introduce a new dataset and use it to showcase weaknesses inherent in existing strategies that naively upsample the target label to match the image resolution. Instead, we present a method that is supervised using low-resolution labels (without upsampling), but takes advantage …
We present a lightweight neural model for remote heart rate estimation focused on the efficient spatio-temporal learning of facial photoplethysmography (PPG) based on i) modelling of PPG dynamics by combinations of multiple convolutional derivatives, and ii) increased flexibility of the model to learn possible offsets between the facial video PPG and the ground truth. PPG dynamics are modelled by a Temporal Derivative Module (TDM) constructed by the incremental aggregation of multiple convolutional derivatives, emulating a Taylor series expansion up to the desired order. Robustness to ground t…
Hunan University(湖南大学);State Key Laboratory of Integrated Services Networks, Xidian University(西安电子科技大学综合业务网理论及关键技术国家重点实验室);Peng Cheng Laboratory(鹏城实验室);Australian National University(澳大利亚国立大学);University of Macau(澳门大学);Sichuan University(四川大学);Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿-罗森多夫研究中心);Helmholtz Institute Freiberg for Resource Technology(亥姆霍兹弗莱贝格资源技术研究所)
The use of deep learning for water extraction requires precise pixel-level labels. However, it is very difficult to label high-resolution remote sensing images at the pixel level. Therefore, we study how to utilize point labels to extract water bodies and propose a novel method called the neighbor feature aggregation network (NFANet). Compared with pixellevel labels, point labels are much easier to obtain, but they will lose much information. In this paper, we take advantage of the similarity between the adjacent pixels of a local water-body, and propose a neighbor sampler to resample remote s…
From Isolation to Collaboration: Federated Class-Heterogeneous Learning for Chest X-Ray Classification
University of Maryland School of Medicine(马里兰大学医学院);University of Maryland Institute for Health Computing(马里兰大学健康计算研究所);St. Jude Children’s Research Hospital(圣犹大儿童研究医院)
GeoSeg-OV: Bridging Geospatial Gaps with Structural Guidance for Open-Vocabulary Remote Sensing Segmentation
School of Computer Science, China University of Geosciences(中国地质大学计算机学院);Systems Hub, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)系统中心);Department of Computer Science, City University of Hong Kong(香港城市大学计算机系);School of Geodesy and Geomatics, Wuhan University(武汉大学测绘学院);Data Science and AI Innovation Research Promotion Center, Shiga University(滋贺大学数据科学与人工智能创新研究促进中心)