When Color-Space Decoupling Meets Diffusion for Adverse-Weather Image Restoration
School of Computer Science and Engineering, Nanjing University of Science and Technology（计算机科学与工程学院，南京理工大学）；School of Electrical Engineering, Southeast University（电气工程学院，东南大学）；School of Intelligence Science and Technology, Nanjing University（智能科学与技术学院，南京大学）
Wenxuan Fang, Jili Fan, Chao Wang, Xiantao Hu, Jiangwei Weng, Ying Tai, Jian Yang, Jun Li
Adverse Weather Image Restoration (AWIR) is a highly challenging task due to the unpredictable and dynamic nature of weather-related degradations. Traditional task-specific methods often fail to generalize to unseen or complex degradation types, while recent prompt-learning approaches depend heavily on the degradation estimation capabilities of vision-language models, resulting in inconsistent restorations. In this paper, we propose \textbf{LCDiff}, a novel framework comprising two key components: \textit{Lumina-Chroma Decomposition Network} (LCDN) and \textit{Lumina-Guided Diffusion Model} (LGDM). LCDN processes degraded images in the YCbCr color space, separately handling degradation-related luminance and degradation-invariant chrominance components. This decomposition effectively mitigates weather-induced degradation while preserving color fidelity. To further enhance restoration quality, LGDM leverages degradation-related luminance information as a guiding condition, eliminating the need for explicit degradation prompts. Additionally, LGDM incorporates a \textit{Dynamic Time Step Loss} to optimize the denoising network, ensuring a balanced recovery of both low- and high-frequency features in the image. Finally, we present DriveWeather, a comprehensive all-weather driving dataset designed to enable robust evaluation. Extensive experiments demonstrate that our approach surpasses state-of-the-art methods, setting a new benchmark in AWIR. The dataset and code are available at: https://github.com/fiwy0527/LCDiff.
Clear Roads, Clear Vision: Advancements in Multi-Weather Restoration for Smart Transportation
Finolex Academy of Management and Technology（Finolex管理与技术学院）；Drone Lab, Centre for Artificial Intelligence and Robotics, IIT Mandi（印度理工学院曼迪分校人工智能与机器人中心无人机实验室）；Mehta Family School of Data Science and Artificial Intelligence, IIT Guwahati（印度理工学院古瓦哈提分校梅塔家族数据科学与人工智能学院）；SPACE42；Centre of Excellence: Artificial Intelligence, School of Computer Science, UPES Dehradun（UPES德拉敦分校计算机科学学院人工智能卓越中心）
Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions
Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China（香港中文大学（深圳）计算机科学与工程系）；Shanghai Artificial Intelligence Laboratory, Shanghai, China（上海人工智能实验室）；ROAS Thrust, the Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China and The Hong Kong University of Science and Technology, Department of Electronic and Computer Engineering, Hong Kong SAR, China（香港科学与技术大学（广州）ROAS方向及电子与计算机工程系，香港特别行政区）
Tsinghua University（清华大学）；Shenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Science（中国科学院深圳先进技术研究院）；Tsinghua Shenzhen International Graduate School（清华大学深圳国际研究生院）；University College London（伦敦大学学院）
Most state-of-the-art semantic segmentation approaches only achieve high accuracy in good conditions. In practically-common but less-discussed adverse environmental conditions, their performance can decrease enormously. Existing studies usually cast the handling of segmentation in adverse conditions as a separate post-processing step after signal restoration, making the segmentation performance largely depend on the quality of restoration. In this paper, we propose a novel deep-learning framework to tackle semantic segmentation and image restoration in adverse environmental conditions in a hol…
GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions
Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））；Hong Kong University of Science and Technology（香港科技大学）；Rakuten Institute of Technology（乐天理工研究院）；Imperial College London（伦敦帝国学院）；KAIST（韩国科学技术院）；Tencent（腾讯）；Australian National University（澳大利亚国立大学）；Nanjing University（南京大学）
CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration
School of Physics（物理学院）；Optoelectronic Engineering, Foshan University, Foshan 528225, China（光学电子工程学院，佛山大学，佛山528225，中国）；Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, Foshan 528225, China（粤港澳联合智能微纳光电子技术实验室，佛山528225，中国）；School of Mechanical Electronic（机械电子学院）；Information Engineering, China University of Mining and Technology, Beijing 100083, China（信息工程学院，中国矿业大学，北京100083，中国）
AWM-Fuse: Multi-Modality Image Fusion for Adverse Weather via Global and Local Text Perception
Guangdong-HongKong-Macao Joint Laboratory for Intelligent MicroNano Optoelectronic Technology（粤港澳联合智能微纳光电子技术联合实验室）；Foshan University（佛山大学）；School of Mechanical Electronic and Information Engineering（机械电子信息工程学院）；China University of Mining and Technology（中国矿业大学）；School of Information Engineering and Automation（信息工程与自动化学院）
Wavelet-Enhanced Desnowing: A Novel Single Image Restoration Approach for Traffic Surveillance under Adverse Weather Conditions
Automatic Control Research Institute, China Nuclear Power Engineering Co., Ltd.（中国核电工程有限公司自动控制研究院）；CNNC Engineering Research Center for Fuel Reprocessing（中核集团燃料后处理工程研究中心）；Chinese Aeronautical Establishment, Aviation Industry Corporation of China, Ltd（中国航空工业集团有限公司中国航空研究院）
WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression
Guangdong University of Technology（广东工业大学）；Sanda University（上海杉达学院）；University of Queensland（昆士兰大学）；Shenzhen MSU-BIT University（深圳北理莫斯科大学）；Zhejiang college of Security Technology（浙江安防职业技术学院）；Northwest China Research Institute of Electronic Equipment（西北电子设备研究所）；Shenzhen Research Institute of Big Data（深圳市大数据研究院）；Shenzhen University（深圳大学）；Misr Higher Institute for Commerce and Computers（米斯尔商业与计算机高等学院）
All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Model
School of Computing, Australian National University（澳大利亚国立大学计算学院）；School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳）计算机科学与技术学院）
Restoring Images in Adverse Weather Conditions via Histogram Transformer
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络安全学院）；School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区网络空间安全学院）；Guangdong Provincial Key Laboratory of Information Security Technology（广东省信息安全技术重点实验室）；Wechat Business Group, Tencent（腾讯微信事业群）
Traffic Image Restoration under Adverse Weather via Frequency-Aware Mamba
School of Communication and Information Engineering, Shanghai University（上海大学通信与信息工程学院）；College of Electronic Science, Air Force Aviation University（空军航空大学电子科学学院）；Intelligent Visual Information Perception Laboratory, Institute of Advanced Technology, Nanjing University of Posts and Telecommunications（南京邮电大学先进技术研究院智能视觉信息感知实验室）；School of Computer Science and Technology, East China Normal University（华东师范大学计算机科学与技术学院）
Nanjing University of Aeronautics and Astronautics（南京航空航天大学）；Lingnan University（岭南大学）；Hong Kong Metropolitan University（香港都会大学）
Adverse weather conditions such as haze, rain, and snow often impair the quality of captured images, causing detection networks trained on normal images to generalize poorly in these scenarios. In this paper, we raise an intriguing question - if the combination of image restoration and object detection, can boost the performance of cutting-edge detectors in adverse weather conditions. To answer it, we propose an effective yet unified detection paradigm that bridges these two subtasks together via dynamic enhancement learning to discern objects in adverse weather conditions, called TogetherNet.…
Nankai International Advanced Research Institute（南开大学国际高等研究院）；Peng Cheng Laboratory（鹏城实验室）；College of Computer Science, Nankai University（南开大学计算机学院）；University of Science and Technology Beijing（北京科技大学）；University of Macau（澳门大学）
Power Line Aerial Image Restoration under dverse Weather: Datasets and Baselines
School of Electrical Engineering and Automation, Nantong University（南通大学电气工程及其自动化学院）；School of Artificial Intelligence and Computer Science, Nantong University（南通大学人工智能与计算机科学学院）；School of Information Science and Technology, Nantong University（南通大学信息科学与技术学院）；College of Computer and Software Engineering, Hohai University（河海大学计算机与软件学院）；School of Electronic and Information Engineering, Suzhou University of Science and Technology（苏州科技大学电子与信息工程学院）；School of Information and Communication Technology, Griffith University（格里菲斯大学信息与通信技术学院）
RoSe: Robust Self-supervised Stereo Matching under Adverse Weather Conditions
Department of Computer Science, City University of Hong Kong（城市大学计算机科学系）；Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Institute of Automation, Chinese Academy of Sciences (CASIA)（中国科学院自动化研究所（CASIA））
Continual All-in-One Adverse Weather Removal with Knowledge Replay on a Unified Network Structure
School of Telecommunications Engineering, Xidian University（西安电子科技大学通信工程学院）；School of Automation, Northwestern Polytechnical University（西北工业大学自动化学院）；Hefei Comprehensive National Science Center（合肥综合性国家科学中心）；University of New South Wales (UNSW)（新南威尔士大学）；Shandong Normal University（山东师范大学）
Diffusion-Based Restoration for Multi-Modal 3D Object Detection in Adverse Weather
School of Xingzhi College, South China Normal University（星智学院，华南师范大学）；College of Big Data and Internet, Shenzhen Technology University（大数据与互联网学院，深圳科技大学）；School of Data Science and Engineering, Xingzhi College, South China Normal University（数据科学与工程学院，星智学院，华南师范大学）；Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology（电子与计算机工程系，香港科技大学）；College of Intelligence Science and Technology, National University of Defense Technology（智能科学与技术学院，国防科技大学）
Despite the recent advances of deep neural networks, object detection for adverse weather remains challenging due to the poor perception of some sensors in adverse weather. Instead of relying on one single sensor, multimodal fusion has been one promising approach to provide redundant detection information based on multiple sensors. However, most existing multimodal fusion approaches are ineffective in adjusting the focus of different sensors under varying detection environments in dynamic adverse weather conditions. Moreover, it is critical to simultaneously observe local and global informatio…
Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagation
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）；University of Cambridge（剑桥大学）；Institute of High Performance Computing, Agency for Science, Technology and Research（新加坡科技研究局高性能计算研究所）；Tianjin University（天津大学）；Hong Kong Metropolitan University（香港都会大学）
We presented a method for improving computer vision tasks on images affected by adverse weather conditions, including distortions caused by adherent raindrops. Overcoming the challenge of applying computer vision to images affected by adverse weather conditions is essential for autonomous vehicles utilizing RGB cameras. For this purpose, we trained an appropriate generative adversarial network and showed that it was effective at removing the effect of the distortions, in the context of image reconstruction and computer vision tasks. We showed that object recognition, a vital task for autonomou…
SemiDDM-Weather: A Semi-supervised Learning Framework for All-in-one Adverse Weather Removal
School of Computer Science and Cyber Engineering, Guangzhou University（广州大学计算机科学与网络工程学院）；College of Engineering, Huaqiao University（华侨大学工学院）；School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区网络空间安全学院）
Reliable point cloud data is essential for perception tasks \textit{e.g.} in robotics and autonomous driving applications. Adverse weather causes a specific type of noise to light detection and ranging (LiDAR) sensor data, which degrades the quality of the point clouds significantly. To address this issue, this letter presents a novel point cloud adverse weather denoising deep learning algorithm (4DenoiseNet). Our algorithm takes advantage of the time dimension unlike deep learning adverse weather denoising methods in the literature. It performs about 10\% better in terms of intersection over …
Object detection in adverse weather conditions for autonomous vehicles using Instruct Pix2Pix
High-Performance Embedded Systems (HPES) Lab（高性能嵌入式系统实验室）；Barcelona Supercomputing Center（巴塞罗那超级计算中心）；Computer Science Dept.（计算机科学系）；Univ. Politècnica de Catalunya（巴塞罗那理工大学）；IDEAI-UPC- Research Center（IDEAI-UPC研究中心）
Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network
School of Automation, Southeast University（东南大学自动化学院）；Chair of Robotics, Artificial Intelligence and Real-time Systems, Technical University of Munich（慕尼黑工业大学机器人、人工智能与实时系统讲席教授组）
