Power Line Aerial Image Restoration under dverse Weather: Datasets and Baselines
School of Electrical Engineering and Automation, Nantong University（南通大学电气工程及其自动化学院）；School of Artificial Intelligence and Computer Science, Nantong University（南通大学人工智能与计算机科学学院）；School of Information Science and Technology, Nantong University（南通大学信息科学与技术学院）；College of Computer and Software Engineering, Hohai University（河海大学计算机与软件学院）；School of Electronic and Information Engineering, Suzhou University of Science and Technology（苏州科技大学电子与信息工程学院）；School of Information and Communication Technology, Griffith University（格里菲斯大学信息与通信技术学院）
Sai Yang, Bin Hu, Bojun Zhou, Fan Liu, Xiaoxin Wu, Xinsong Zhang, Juping Gu, Jun Zhou
电力线自主巡检（Power Line Autonomous Inspection，PLAI）凭借低成本、高效率和安全运行的显著优势，在智能电网建设中发挥着关键作用。PLAI通过准确检测无人机（Unmanned Aerial Vehicles，UAVs）拍摄的航空图像中的电气部件和缺陷来完成。然而，航空图像的可见质量不可避免地会因雾霾、降雨或降雪等恶劣天气而下降；我们的研究发现，这些天气会大幅降低检测精度。为解决这一问题，我们提出了一项新任务——恶劣天气下的电力线航空图像复原（Power Line Aerial Image Restoration under Adverse Weather，PLAIR-AW），旨在从受恶劣天气影响的退化图像中恢复出干净、高质量的图像，从而提升PLAI的检测性能。在此背景下，我们首次发布了大量相应数据集，即用于电力线航空图像去雾的HazeCPLID、HazeTTPLA、HazeInsPLAD，用于电力线航空图像去雨的RainCPLID、RainTTPLA、RainInsPLAD，以及用于电力线航空图像去雪的SnowCPLID、SnowInsPLAD；这些数据集依据数学模型，在公开电力线航空图像数据集CPLID、TTPLA和InsPLAD的基础上合成得到。同时，我们从图像复原领域选取了大量最先进方法作为PLAIR-AW的基线方法。最后，我们开展了大规模实证实验，以评估各基线方法在所提出数据集上的性能。所提出的数据集和训练后的模型可在https://github.com/ntuhubin/PLAIR-AW获取。
英文摘要：
Power Line Autonomous Inspection (PLAI) plays a crucial role in the construction of smart grids due to its great advantages of low cost, high efficiency, and safe operation. PLAI is completed by accurately detecting the electrical components and defects in the aerial images captured by Unmanned Aerial Vehicles (UAVs). However, the visible quality of aerial images is inevitably degraded by adverse weather like haze, rain, or snow, which are found to drastically decrease the detection accuracy in our research. To circumvent this problem, we propose a new task of Power Line Aerial Image Restoration under Adverse Weather (PLAIR-AW), which aims to recover clean and high-quality images from degraded images with bad weather thus improving detection performance for PLAI. In this context, we are the first to release numerous corresponding datasets, namely, HazeCPLID, HazeTTPLA, HazeInsPLAD for power line aerial image dehazing, RainCPLID, RainTTPLA, RainInsPLAD for power line aerial image deraining, SnowCPLID, SnowInsPLAD for power line aerial image desnowing, which are synthesized upon the public power line aerial image datasets of CPLID, TTPLA, InsPLAD following the mathematical models. Meanwhile, we select numerous state-of-the-art methods from image restoration community as the baseline methods for PLAIR-AW. At last, we conduct large-scale empirical experiments to evaluate the performance of baseline methods on the proposed datasets. The proposed datasets and trained models are available at https://github.com/ntuhubin/PLAIR-AW.
Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions
Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China（香港中文大学（深圳）计算机科学与工程系）；Shanghai Artificial Intelligence Laboratory, Shanghai, China（上海人工智能实验室）；ROAS Thrust, the Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China and The Hong Kong University of Science and Technology, Department of Electronic and Computer Engineering, Hong Kong SAR, China（香港科学与技术大学（广州）ROAS方向及电子与计算机工程系，香港特别行政区）
GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions
Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））；Hong Kong University of Science and Technology（香港科技大学）；Rakuten Institute of Technology（乐天理工研究院）；Imperial College London（伦敦帝国学院）；KAIST（韩国科学技术院）；Tencent（腾讯）；Australian National University（澳大利亚国立大学）；Nanjing University（南京大学）
Wavelet-Enhanced Desnowing: A Novel Single Image Restoration Approach for Traffic Surveillance under Adverse Weather Conditions
Automatic Control Research Institute, China Nuclear Power Engineering Co., Ltd.（中国核电工程有限公司自动控制研究院）；CNNC Engineering Research Center for Fuel Reprocessing（中核集团燃料后处理工程研究中心）；Chinese Aeronautical Establishment, Aviation Industry Corporation of China, Ltd（中国航空工业集团有限公司中国航空研究院）
All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Model
School of Computing, Australian National University（澳大利亚国立大学计算学院）；School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳）计算机科学与技术学院）
CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration
School of Physics（物理学院）；Optoelectronic Engineering, Foshan University, Foshan 528225, China（光学电子工程学院，佛山大学，佛山528225，中国）；Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, Foshan 528225, China（粤港澳联合智能微纳光电子技术实验室，佛山528225，中国）；School of Mechanical Electronic（机械电子学院）；Information Engineering, China University of Mining and Technology, Beijing 100083, China（信息工程学院，中国矿业大学，北京100083，中国）
Nankai International Advanced Research Institute（南开大学国际高等研究院）；Peng Cheng Laboratory（鹏城实验室）；College of Computer Science, Nankai University（南开大学计算机学院）；University of Science and Technology Beijing（北京科技大学）；University of Macau（澳门大学）
Traffic Image Restoration under Adverse Weather via Frequency-Aware Mamba
School of Communication and Information Engineering, Shanghai University（上海大学通信与信息工程学院）；College of Electronic Science, Air Force Aviation University（空军航空大学电子科学学院）；Intelligent Visual Information Perception Laboratory, Institute of Advanced Technology, Nanjing University of Posts and Telecommunications（南京邮电大学先进技术研究院智能视觉信息感知实验室）；School of Computer Science and Technology, East China Normal University（华东师范大学计算机科学与技术学院）
Nanjing University of Aeronautics and Astronautics（南京航空航天大学）；Lingnan University（岭南大学）；Hong Kong Metropolitan University（香港都会大学）
Adverse weather conditions such as haze, rain, and snow often impair the quality of captured images, causing detection networks trained on normal images to generalize poorly in these scenarios. In this paper, we raise an intriguing question - if the combination of image restoration and object detection, can boost the performance of cutting-edge detectors in adverse weather conditions. To answer it, we propose an effective yet unified detection paradigm that bridges these two subtasks together via dynamic enhancement learning to discern objects in adverse weather conditions, called TogetherNet.…
When Color-Space Decoupling Meets Diffusion for Adverse-Weather Image Restoration
School of Computer Science and Engineering, Nanjing University of Science and Technology（计算机科学与工程学院，南京理工大学）；School of Electrical Engineering, Southeast University（电气工程学院，东南大学）；School of Intelligence Science and Technology, Nanjing University（智能科学与技术学院，南京大学）
WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression
Guangdong University of Technology（广东工业大学）；Sanda University（上海杉达学院）；University of Queensland（昆士兰大学）；Shenzhen MSU-BIT University（深圳北理莫斯科大学）；Zhejiang college of Security Technology（浙江安防职业技术学院）；Northwest China Research Institute of Electronic Equipment（西北电子设备研究所）；Shenzhen Research Institute of Big Data（深圳市大数据研究院）；Shenzhen University（深圳大学）；Misr Higher Institute for Commerce and Computers（米斯尔商业与计算机高等学院）
All-in-One Video Restoration under Smoothly Evolving Unknown Weather Degradations
Department of Computer Science and Technology, Harbin Institute of Technology（计算机科学与技术系，哈尔滨工业大学）；Peng Cheng Laboratory, Shenzhen, China（鹏城实验室，深圳，中国）；School of Computer Science, Peking University（计算机学院，北京大学）
Learning to recover clear images from images having a combination of degrading factors is a challenging task. That being said, autonomous surveillance in low visibility conditions caused by high pollution/smoke, poor air quality index, low light, atmospheric scattering, and haze during a blizzard becomes even more important to prevent accidents. It is thus crucial to form a solution that can result in a high-quality image and is efficient enough to be deployed for everyday use. However, the lack of proper datasets available to tackle this task limits the performance of the previous methods pro…
Modern applications such as self-driving cars and drones rely heavily upon robust object detection techniques. However, weather corruptions can hinder the object detectability and pose a serious threat to their navigation and reliability. Thus, there is a need for efficient denoising, deraining, and restoration techniques. Generative adversarial networks and transformers have been widely adopted for image restoration. However, the training of these methods is often unstable and time-consuming. Furthermore, when used for object detection (OD), the output images generated by these methods may pr…
Jimei University（集美大学）；Southwest University（西南大学）；China University of Petroleum（中国石油大学）
Removing adverse weather conditions like rain, fog, and snow from images is a challenging problem. Although the current recovery algorithms targeting a specific condition have made impressive progress, it is not flexible enough to deal with various degradation types. We propose an efficient and compact image restoration network named DAN-Net (Degradation-Adaptive Neural Network) to address this problem, which consists of multiple compact expert networks with one adaptive gated neural. A single expert network efficiently addresses specific degradation in nasty winter scenes relying on the compa…
Aerial image registration or matching is a geometric process of aligning two aerial images captured in different environments. Estimating the precise transformation parameters is hindered by various environments such as time, weather, and viewpoints. The characteristics of the aerial images are mainly composed of a straight line owing to building and road. Therefore, the straight lines are distorted when estimating homography parameters directly between two images. In this paper, we propose a deep homography alignment network to precisely match two aerial images by progressively estimating the…
Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration
Samsung AI Center Cambridge（三星剑桥人工智能中心）；National Taiwan University（国立台湾大学）；Technical University of Iasi（雅西科技大学）；Chang Gung University（长庚大学）；University of Wurzburg（维尔茨堡大学）；Queen Mary University of London（伦敦玛丽女王大学）
DA2Diff: Exploring Degradation-aware Adaptive Diffusion Priors for All-in-One Weather Restoration
School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics（南京航空航天大学计算机科学与技术学院）；Collaborative Innovation Center of Novel Software Technology and Industrialization（新型软件技术与产业化协同创新中心）；College of Computer Science and Technology, Anhui University of Technology（安徽工业大学计算机科学与技术学院）；Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）
Fractal-IR: A Unified Framework for Efficient and Scalable Image Restoration
ETH Zürich（苏黎世联邦理工学院）；University of Pisa（比萨大学）；University of Trento（特伦托大学）；Meta Reality Labs（元宇宙现实实验室）；Peking University（北京大学）；University of California, Merced（加州大学默塞德分校）
Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network
School of Automation, Southeast University（东南大学自动化学院）；Chair of Robotics, Artificial Intelligence and Real-time Systems, Technical University of Munich（慕尼黑工业大学机器人、人工智能与实时系统讲席教授组）
Restoring Vision in Hazy Weather with Hierarchical Contrastive Learning
Nanjing University（南京大学）；Memorial University of Newfoundland（纽芬兰纪念大学）；Australian National University（澳大利亚国立大学）；Sun Yat-sen University（中山大学）；Wenzhou University（温州大学）
CoRE-UIR: Prior-guided common and residual experts for efficient all-in-one remote sensing image restoration
School of Geodesy and Geomatics, Wuhan University（武汉大学测绘学院）；School of Artificial Intelligence, Wuhan University（武汉大学人工智能学院）；State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University（武汉大学测绘遥感信息工程国家重点实验室）
6thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preserving
Harbin Institute of Technology（哈尔滨工业大学）；Nanjing University of Science and Technology（南京理工大学）；National University of Defense Technology（国防科技大学）；Shandong Normal University（山东师范大学）；Qilu University of Technology（齐鲁工业大学）
Existing approaches for restoring weather-degraded images follow a fully-supervised paradigm and they require paired data for training. However, collecting paired data for weather degradations is extremely challenging, and existing methods end up training on synthetic data. To overcome this issue, we describe an approach for supervising deep networks that are based on CycleGAN, thereby enabling the use of unlabeled real-world data for training. Specifically, we introduce new losses for training CycleGAN that lead to more effective training, resulting in high-quality reconstructions. These new …
CSE, Nanjing University of Science and Technology（南京理工大学计算机科学与工程学院）；SISE, Shandong Normal University（山东师范大学信息科学与工程学院）
The exposed cameras of UAV can shake, shift, or even malfunction under the influence of harsh weather, while the add-on devices (Dupont lines) are very vulnerable to damage. We can place a low-cost T-OLED overlay around the camera to protect it, but this would also introduce image degradation issues. In particular, the temperature variations in the atmosphere can create mist that adsorbs to the T-OLED, which can cause secondary disasters (i.e., more severe image degradation) during the UAV's filming process. To solve the image degradation problem caused by overlaying T-OLEDs, in this paper we …
Aerial images are often degraded by space-varying motion blur and simultaneous uneven illumination. To recover high-quality aerial image from its non-uniform version, we propose a novel patch-wise restoration approach based on a key observation that the degree of blurring is inevitably affected by the illuminated conditions. A non-local Retinex model is developed to accurately estimate the reflectance component from the degraded aerial image. Thereafter the uneven illumination is corrected well. And then non-uniform coupled blurring in the enhanced reflectance image is alleviated and transform…
Restoring Images in Adverse Weather Conditions via Histogram Transformer
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络安全学院）；School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区网络空间安全学院）；Guangdong Provincial Key Laboratory of Information Security Technology（广东省信息安全技术重点实验室）；Wechat Business Group, Tencent（腾讯微信事业群）
Unified Restoration-Perception Learning: Maritime Infrared-Visible Image Fusion and Segmentation
Laboratory of Underwater Acoustic Communication and Marine Information Technology, Ministry of Education, Xiamen University（厦门大学水声通信与海洋信息技术教育部重点实验室）；PAMI Research Group, Department of Computer and Information Science, University of Macau（澳门大学计算机与信息科学系PAMI研究组）；School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区网络空间安全学院）
Degradation-Aware Adaptive Context Gating for Unified Image Restoration
School of Computing and Artificial Intelligence, Southwest Jiaotong University（计算机与人工智能学院，西南交通大学）；Institute for Infocomm Research, Agency for Science, Technology and Research（信息通信研究院，科技研究局）；School of Computing and Artificial Intelligence, Jiangxi University of Finance and Economics（计算机与人工智能学院，江西财经大学）；School of Information Management, Jiangxi University of Finance and Economics（信息管理学院，江西财经大学）；Engineering Research Center of Sustainable Urban Intelligent Transportation, Ministry of Education（可持续智慧城市交通工程研究中心，教育部）；National Engineering Laboratory of Integrated Transportation Big Data Application Technology, Southwest Jiaotong University（综合交通运输大数据应用技术国家工程实验室，西南交通大学）
ResLPR: A LiDAR Data Restoration Network and Benchmark for Robust Place Recognition Against Weather Corruptions
College of Intelligence Science and Technology（智能科学与技术学院）；National University of Defense Technology（国防科技大学）；Harbin Institute of Technology（哈尔滨工业大学）；New York University Abu Dhabi（纽约大学阿布扎比分校）；University of Science and Technology of China（中国科学技术大学）
In recent years, convolutional neural network-based single image adverse weather removal methods have achieved significant performance improvements on many benchmark datasets. However, these methods require large amounts of clean-weather degraded image pairs for training, which is often difficult to obtain in practice. Although various weather degradation synthesis methods exist in the literature, the use of synthetically generated weather degraded images often results in sub-optimal performance on the real weather degraded images due to the domain gap between synthetic and real-world images. …
