Learning to Holistically Detect Bridges from Large-Size VHR Remote Sensing Imagery
Wuhan University（武汉大学）；Huazhong University of Science and Technology（华中科技大学）；South China University of Technology（华南理工大学）；ByteDance AI Lab（字节跳动人工智能实验室）
Yansheng Li, Junwei Luo, Yongjun Zhang, Yihua Tan, Jin-Gang Yu, Song Bai
备注：
16 pages, 11 figures, 6 tables; due to the limitation "The abstract field cannot be longer than 1,920 characters", the abstract appearing here is slightly shorter than that in the PDF file
Bridge detection in remote sensing images (RSIs) plays a crucial role in various applications, but it poses unique challenges compared to the detection of other objects. In RSIs, bridges exhibit considerable variations in terms of their spatial scales and aspect ratios. Therefore, to ensure the visibility and integrity of bridges, it is essential to perform holistic bridge detection in large-size very-high-resolution (VHR) RSIs. However, the lack of datasets with large-size VHR RSIs limits the deep learning algorithms' performance on bridge detection. Due to the limitation of GPU memory in tackling large-size images, deep learning-based object detection methods commonly adopt the cropping strategy, which inevitably results in label fragmentation and discontinuous prediction. To ameliorate the scarcity of datasets, this paper proposes a large-scale dataset named GLH-Bridge comprising 6,000 VHR RSIs sampled from diverse geographic locations across the globe. These images encompass a wide range of sizes, varying from 2,048*2,048 to 16,38*16,384 pixels, and collectively feature 59,737 bridges. Furthermore, we present an efficient network for holistic bridge detection (HBD-Net) in large-size RSIs. The HBD-Net presents a separate detector-based feature fusion (SDFF) architecture and is optimized via a shape-sensitive sample re-weighting (SSRW) strategy. Based on the proposed GLH-Bridge dataset, we establish a bridge detection benchmark including the OBB and HBB tasks, and validate the effectiveness of the proposed HBD-Net. Additionally, cross-dataset generalization experiments on two publicly available datasets illustrate the strong generalization capability of the GLH-Bridge dataset.
Cross-View Geolocalization and Disaster Mapping with Street-View and VHR Satellite Imagery: A Case Study of Hurricane IAN
Technical University of Munich（慕尼黑工业大学）；University of the Bundeswehr Munich（慕尼黑联邦国防军大学）；China University of Mining and Technology（中国矿业大学）；University of Texas at Austin（德克萨斯大学奥斯汀分校）；Tongji University（同济大学）
Cross-View Geo-Localization with Street-View and VHR Satellite Imagery in Decentrality Settings
School of Remote Sensing and Information Engineering, Wuhan University（武汉大学遥感信息工程学院）；Ant Group（蚂蚁集团）；Technology Innovation Center for Collaborative Applications of Natural Resources Data in GBA, Ministry of Natural Resources（自然资源部粤港澳自然资源数据协同应用技术创新中心）
STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagery
School of Remote Sensing and Information Engineering, Wuhan University（武汉大学遥感信息工程学院）；OpenGVLab, Shanghai AI Laboratory（上海人工智能实验室OpenGVLab）；School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University（西北工业大学人工智能、光学与电子学院（iOPEN））；Department of Computer Science, Cornell University（康奈尔大学计算机科学系）；Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院）；School of Geosciences and Info-Physics, Central South University（中南大学地球科学与信息物理学院）；School of Automation, Southeast University（东南大学自动化学院）；School of Artificial Intelligence, Shanghai Jiao Tong University（上海交通大学人工智能学院）
Global surface water detection in very-high-resolution (VHR) satellite imagery can directly serve major applications such as refined flood mapping and water resource assessment. Although achievements have been made in detecting surface water in small-size satellite images corresponding to local geographic scales, datasets and methods suitable for mapping and analyzing global surface water have yet to be explored. To encourage the development of this task and facilitate the implementation of relevant applications, we propose the GLH-water dataset that consists of 250 satellite images and manual…
Is sub-metre resolution necessary for cocoa mapping? A landscape-stratified evaluation of very high resolution imagery, decametric Earth Observation inputs, and operational products in Cote d'Ivoire
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）
It is very useful and increasingly popular to extract accurate road centerlines from very-high-resolution (VHR) re- mote sensing imagery for various applications, such as road map generation and updating etc. There are three shortcomings of current methods: (a) Due to the noise and occlusions (owing to vehicles and trees), most road extraction methods bring in heterogeneous classification results; (b) Morphological thinning algorithm is widely used to extract road centerlines, while it pro- duces small spurs around the centerlines; (c) Many methods are ineffective to extract centerlines around…
A Deep Learning framework for building damage assessment using VHR SAR and geospatial data: demonstration on the 2023 Turkiye Earthquake
Department of Electrical, Computer and Biomedical Engineering, University of Pavia（帕维亚大学电气、计算机与生物医学工程系）；Department of Engineering, University of Sannio（萨诺尼奥大学工程系）；Italian Space Agency (ASI)（意大利航天局）
This paper proposes a novel domain adaptation algorithm to handle the challenges posed by the satellite and aerial imagery, and demonstrates its effectiveness on the built-up region segmentation problem. Built-up area estimation is an important component in understanding the human impact on the environment, the effect of public policy, and general urban population analysis. The diverse nature of aerial and satellite imagery and lack of labeled data covering this diversity makes machine learning algorithms difficult to generalize for such tasks, especially across multiple domains. On the other …
SARLO-80: Worldwide Slant SAR Language Optic Dataset 80cm
DEMR-ONERA – The French Aerospace Lab, Université Paris-Saclay（法国航空航天实验室DEMR-ONERA，巴黎-萨克雷大学）；DTIS-ONERA – The French Aerospace Lab, Université Paris-Saclay（法国航空航天实验室DTIS-ONERA，巴黎-萨克雷大学）；Hugging Face
Change detection for aerial imagery involves locating and identifying changes associated with the areas of interest between co-registered bi-temporal or multi-temporal images of a geographical location. Farm ponds are man-made structures belonging to the category of minor irrigation structures used to collect surface run-off water for future irrigation purposes. Detection of farm ponds from aerial imagery and their evolution over time helps in land surveying to analyze the agricultural shifts, policy implementation, seasonal effects and climate changes. In this paper, we introduce a publicly a…
Smart Transfer: Leveraging Vision Foundation Model for Rapid Building Damage Mapping with Post-Earthquake VHR Imagery
Department of Geography, National University of Singapore（新加坡国立大学地理系）；Urban Governance and Design Thrust, The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）城市治理与设计学域）；School of Environment and Spatial Informatics, China University of Mining and Technology（中国矿业大学环境与空间信息学院）；Disaster Management Institute, Istanbul Technical University（伊斯坦布尔技术大学灾害管理研究所）；Department of Complexity Science and Engineering, University of Tokyo（东京大学复杂科学与工程系）；School of Automation, Southeast University（东南大学自动化学院）
The State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University（武汉大学测绘遥感信息工程国家重点实验室）；School of Computer, Wuhan University（武汉大学计算机学院）
Mega-city analysis with very high resolution (VHR) satellite images has been drawing increasing interest in the fields of city planning and social investigation. It is known that accurate land-use, urban density, and population distribution information is the key to mega-city monitoring and environmental studies. Therefore, how to generate land-use, urban density, and population distribution maps at a fine scale using VHR satellite images has become a hot topic. Previous studies have focused solely on individual tasks with elaborate hand-crafted features and have ignored the relationship betwe…
Building Age Estimation: A New Multi-Modal Benchmark Dataset and Community Challenge
European Space Agency（欧洲航天局）；Φ \Phi -lab（Phi实验室）；ESRIN（ESRIN研究所）；MindEarth（MindEarth公司）；Sinergise/ Planet（Sinergise/Planet公司）；TelePIX（TelePIX公司）；Axelspace Corporation（Axelspace公司）；Helmholtz Institute Hereon（海德堡研究所）；German Climate Computing Center DKRZ（德国气候计算中心DKRZ）
Where are the Whales: A Human-in-the-loop Detection Method for Identifying Whales in High-resolution Satellite Imagery
Microsoft AI for Good Research Lab（微软人工智能为善研究实验室）；Marine Mammal Laboratory（海洋哺乳动物实验室）；National Marine Fisheries Service（国家海洋渔业服务）；Northeast Fisheries Science Center（东北渔业科学中心）；NoAA（国家海洋和大气管理局）；Protected Resources Division（保护资源部门）
Large datasets of sub-meter aerial imagery represented as orthophoto mosaics are widely available today, and these data sets may hold a great deal of untapped information. This imagery has a potential to locate several types of features; for example, forests, parking lots, airports, residential areas, or freeways in the imagery. However, the appearances of these things vary based on many things including the time that the image is captured, the sensor settings, processing done to rectify the image, and the geographical and cultural context of the region captured by the image. This thesis explo…
In this paper we test the use of a deep learning approach to automatically count Wandering Albatrosses in Very High Resolution (VHR) satellite imagery. We use a dataset of manually labelled imagery provided by the British Antarctic Survey to train and develop our methods. We employ a U-Net architecture, designed for image segmentation, to simultaneously classify and localise potential albatrosses. We aid training with the use of the Focal Loss criterion, to deal with extreme class imbalance in the dataset. Initial results achieve peak precision and recall values of approximately 80%. Finally w…
An Object-Based Deep Learning Approach for Building Height Estimation from Single SAR Images
Department of Electrical, Computer and Biomedical Engineering, University of Pavia（电子、计算机与生物医学工程系，帕维亚大学）；Department of Engineering, University of Sannio（工程系，萨尼奥大学）
Beluga Whale Detection from Satellite Imagery with Point Labels
Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院 aerospace information research institute）；School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences（中国科学院大学电子、电气与通信工程学院）；College of Resources and Environment, University of Chinese Academy of Sciences（中国科学院大学资源与环境学院）；Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences（中国科学院地理科学与自然资源研究所）；Chinese Research Academy of Environmental Sciences（中国环境科学研究院）；School of Future Technology, University of Chinese Academy of Sciences（中国科学院大学未来技术学院）；Technical Institute of Physics and Chemistry, Chinese Academy of Sciences（中国科学院物理化学技术研究所）
本文提出结合点标注与 SAM 自动生成边界框并训练 YOLOv8 的流程，实现 VHR 卫星影像中确定鲸鱼、不确定鲸鱼和竖琴海豹的多类别检测。
Embedding Generalized Semantic Knowledge into Few-Shot Remote Sensing Segmentation
School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University（西北工业大学人工智能与光学电子学院（iOPEN））；Data Science in Earth Observation, Technical University of Munich（慕尼黑工业大学地球观测数据科学系）
School of Computer Engineering, Iran University of Science and Technology（伊朗科技大学计算机工程学院）
Automatic airplane detection in aerial imagery has a variety of applications. Two of the significant challenges in this task are variations in the scale and direction of the airplanes. To solve these challenges, we present a rotation-and-scale invariant airplane proposal generator. We call this generator symmetric line segments (SLS) that is developed based on the symmetric and regular boundaries of airplanes from the top view. Then, the generated proposals are used to train a deep convolutional neural network for removing non-airplane proposals. Since each airplane can have multiple SLS propo…
Ensembling is a method that aims to maximize the detection performance by fusing individual detectors. While rarely mentioned in deep-learning articles applied to remote sensing, ensembling methods have been widely used to achieve high scores in recent data science com-petitions, such as Kaggle. The few remote sensing articles mentioning ensembling mainly focus on mid resolution images and earth observation applications such as land use classification, but never on Very High Resolution (VHR) images for defense-related applications or object detection.This study aims at reviewing the most relev…
German Aerospace Center（德国航空航天中心）；Technical University of Munich（慕尼黑工业大学）
Automatic multi-class object detection in remote sensing images in unconstrained scenarios is of high interest for several applications including traffic monitoring and disaster management. The huge variation in object scale, orientation, category, and complex backgrounds, as well as the different camera sensors pose great challenges for current algorithms. In this work, we propose a new method consisting of a novel joint image cascade and feature pyramid network with multi-size convolution kernels to extract multi-scale strong and weak semantic features. These features are fed into rotation-b…
DeepMerge: Deep-Learning-Based Region-Merging for Image Segmentation
Northeastern University at Qinhuangdao（东北大学秦皇岛分校）；University of Twente（特文特大学）；Wuhan University（武汉大学）；University of Arkansas（阿肯色大学）；China University of Geosciences (Beijing)（中国地质大学（北京））
Technical University of Munich（慕尼黑工业大学）；Remote Sensing Technology Institute, German Aerospace Center（德国航空航天中心遥感技术研究所）
In this letter, we propose a pseudo-siamese convolutional neural network (CNN) architecture that enables to solve the task of identifying corresponding patches in very-high-resolution (VHR) optical and synthetic aperture radar (SAR) remote sensing imagery. Using eight convolutional layers each in two parallel network streams, a fully connected layer for the fusion of the features learned in each stream, and a loss function based on binary cross-entropy, we achieve a one-hot indication if two patches correspond or not. The network is trained and tested on an automatically generated dataset that…
SARU: A Shadow-Aware and Removal Unified Framework for Remote Sensing Images with New Benchmarks
MOE Key Lab of ICSP, Anhui Provincial Key Lab of Multimodal Cognitive Computation, IMIS Lab of Anhui Province, School of Computer Science and Technology, Anhui University, Hefei, China（教育部信息与通信系统重点实验室、安徽省多模态认知计算重点实验室、安徽省IMIS实验室、计算机科学与技术学院、安徽大学、合肥，中国）；Graduate School of Frontier Sciences, The University of Tokyo, Chiba, 277-8561, Japan（前沿科学研究生院、东京大学、千叶，日本）
GRAD-Former: Gated Robust Attention-based Differential Transformer for Change Detection
Indian Knowledge System and Mental Health Applications (IKSMHA) Center, IIT Mandi（印度知识系统与心理健康应用中心，IIT曼迪）；School of Computing, IIIT Una（计算学院，IIITUna）；Center of Artificial Intelligence and Robotics (CAIR), IIT Mandi（人工智能与机器人中心，IIT曼迪）
High-Frequency Semantics and Geometric Priors for End-to-End Detection Transformers in Challenging UAV Imagery
College of Mathematics and Informatics（数学与信息学院）；South China Agricultural University（华南农业大学）；Key Laboratory of Smart Agricultural Technology in Tropical South China, Ministry of Agriculture and Rural Affairs（热带南中国智能农业技术重点实验室，农业农村部）；School of Economics and Trade（经济贸易学院）
Deep Learning for Slum Mapping in Remote Sensing Images: A Meta-analysis and Review
Centre of Excellence in Artificial Intelligence, Indian Institute of Technology Kharagpur（印度理工学院卡拉格普尔分校人工智能卓越中心）；Tata Consultancy Services Research（塔塔咨询服务公司研究院）
SAM2-ELNet: Label Enhancement and Automatic Annotation for Remote Sensing Segmentation
College of Instrumentation and Electrical Engineering, Jilin University（吉林大学仪器电气工程学院）；Key Laboratory of Geophysical Exploration Equipment, Ministry of Education（教育部地球物理探测装备重点实验室）；School of Mathematics, Jilin University（吉林大学数学学院）
MBZ University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Wuhan University（武汉大学）
Deep learning-based algorithms have seen a massive popularity in different areas of remote sensing image analysis over the past decade. Recently, transformers-based architectures, originally introduced in natural language processing, have pervaded computer vision field where the self-attention mechanism has been utilized as a replacement to the popular convolution operator for capturing long-range dependencies. Inspired by recent advances in computer vision, remote sensing community has also witnessed an increased exploration of vision transformers for a diverse set of tasks. Although a number…
This paper introduces the use of single layer and deep convolutional networks for remote sensing data analysis. Direct application to multi- and hyper-spectral imagery of supervised (shallow or deep) convolutional networks is very challenging given the high input data dimensionality and the relatively small amount of available labeled data. Therefore, we propose the use of greedy layer-wise unsupervised pre-training coupled with a highly efficient algorithm for unsupervised learning of sparse features. The algorithm is rooted on sparse representations and enforces both population and lifetime …
YOLO-SPCI: Enhancing Remote Sensing Object Detection via Selective-Perspective-Class Integration
Faculty of Innovation Engineering, Macau University of Science and Technology（澳门科技大学创新工程学院）；School of Computer and Information Science, Southwest University（西南大学计算机与信息科学学院）；College of Automation and Information Engineering, Nanjing University of Posts and Telecommunications（南京邮电大学自动化与信息工程学院）
Indian Institute of Technology Bombay（印度理工学院孟买分校）；German Aerospace Center (DLR)（德国航空航天中心）
We address the problem of cross-modal information retrieval in the domain of remote sensing. In particular, we are interested in two application scenarios: i) cross-modal retrieval between panchromatic (PAN) and multi-spectral imagery, and ii) multi-label image retrieval between very high resolution (VHR) images and speech based label annotations. Notice that these multi-modal retrieval scenarios are more challenging than the traditional uni-modal retrieval approaches given the inherent differences in distributions between the modalities. However, with the growing availability of multi-source …
InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images
School of Remote Sensing and Information Engineering, Wuhan University（武汉大学遥感信息工程学院）；Electronic Information School, Wuhan University（武汉大学电子信息学院）；Electrical and Computer Engineering, King Abdullah University of Science and Technology（阿卜杜拉国王科技大学电气与计算机工程学院）
Generalization-Enhanced Few-Shot Object Detection in Remote Sensing
China Academy of Electronics and Information Technology（中国电子科技集团公司电子科学研究院）；National Satellite Meteorological Center（国家卫星气象中心）；Innovation Center for FengYun Meteorological Satellite（风云气象卫星创新中心）；China Meteorological Administration（中国气象局）；Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院）；University of Chinese Academy of Sciences（中国科学院大学）；School of Automation and Electrical Engineering, University of Science and Technology Beijing（北京科技大学自动化与电气工程学院）；New York University Abu Dhabi（纽约大学阿布扎比分校）
The recent thrust on digital agriculture (DA) has renewed significant research interest in the automated delineation of agricultural fields. Most prior work addressing this problem have focused on detecting medium to large fields, while there is strong evidence that around 40\% of the fields world-wide and 70% of the fields in Asia and Africa are small. The lack of adequate labeled images for small fields, huge variations in their color, texture, and shape, and faint boundary lines separating them make it difficult to develop an end-to-end learning model for detecting such fields. Hence, in th…
