All-in-One Video Restoration under Smoothly Evolving Unknown Weather Degradations
Department of Computer Science and Technology, Harbin Institute of Technology(计算机科学与技术系,哈尔滨工业大学);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室,深圳,中国);School of Computer Science, Peking University(计算机学院,北京大学)
Wenrui Li, Hongtao Chen, Yao Xiao, Wangmeng Zuo, Jiantao Zhou, Yonghong Tian, Xiaopeng Fan
All-in-one image restoration aims to recover clean images from diverse unknown degradations using a single model. But extending this task to videos faces unique challenges. Existing approaches primarily focus on frame-wise degradation variation, overlooking the temporal continuity that naturally exists in real-world degradation processes. In practice, degradation types and intensities evolve smoothly over time, and multiple degradations may coexist or transition gradually. In this paper, we introduce the Smoothly Evolving Unknown Degradations (SEUD) scenario, where both the active degradation set and degradation intensity change continuously over time. To support this scenario, we design a flexible synthesis pipeline that generates temporally coherent videos with single, compound, and evolving degradations. To address the challenges in the SEUD scenario, we propose an all-in-One Recurrent Conditional and Adaptive prompting Network (ORCANet). First, a Coarse Intensity Estimation Dehazing (CIED) module estimates haze intensity using physical priors and provides coarse dehazed features as initialization. Second, a Flow Prompt Generation (FPG) module extracts degradation features. FPG generates both static prompts that capture segment-level degradation types and dynamic prompts that adapt to frame-level intensity variations. Furthermore, a label-aware supervision mechanism improves the discriminability of static prompt representations under different degradations. Extensive experiments show that ORCANet achieves superior restoration quality, temporal consistency, and robustness over image and video-based baselines. Code is available at https://github.com/Friskknight/ORCANet-SEUD.
Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions
Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China(香港中文大学(深圳)计算机科学与工程系);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室);ROAS Thrust, the Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China and The Hong Kong University of Science and Technology, Department of Electronic and Computer Engineering, Hong Kong SAR, China(香港科学与技术大学(广州)ROAS方向及电子与计算机工程系,香港特别行政区)
GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Hong Kong University of Science and Technology(香港科技大学);Rakuten Institute of Technology(乐天理工研究院);Imperial College London(伦敦帝国学院);KAIST(韩国科学技术院);Tencent(腾讯);Australian National University(澳大利亚国立大学);Nanjing University(南京大学)
Wavelet-Enhanced Desnowing: A Novel Single Image Restoration Approach for Traffic Surveillance under Adverse Weather Conditions
Automatic Control Research Institute, China Nuclear Power Engineering Co., Ltd.(中国核电工程有限公司自动控制研究院);CNNC Engineering Research Center for Fuel Reprocessing(中核集团燃料后处理工程研究中心);Chinese Aeronautical Establishment, Aviation Industry Corporation of China, Ltd(中国航空工业集团有限公司中国航空研究院)
All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Model
School of Computing, Australian National University(澳大利亚国立大学计算学院);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院)
CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration
School of Physics(物理学院);Optoelectronic Engineering, Foshan University, Foshan 528225, China(光学电子工程学院,佛山大学,佛山528225,中国);Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, Foshan 528225, China(粤港澳联合智能微纳光电子技术实验室,佛山528225,中国);School of Mechanical Electronic(机械电子学院);Information Engineering, China University of Mining and Technology, Beijing 100083, China(信息工程学院,中国矿业大学,北京100083,中国)
Nankai International Advanced Research Institute(南开大学国际高等研究院);Peng Cheng Laboratory(鹏城实验室);College of Computer Science, Nankai University(南开大学计算机学院);University of Science and Technology Beijing(北京科技大学);University of Macau(澳门大学)
Traffic Image Restoration under Adverse Weather via Frequency-Aware Mamba
School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);College of Electronic Science, Air Force Aviation University(空军航空大学电子科学学院);Intelligent Visual Information Perception Laboratory, Institute of Advanced Technology, Nanjing University of Posts and Telecommunications(南京邮电大学先进技术研究院智能视觉信息感知实验室);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院)
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Lingnan University(岭南大学);Hong Kong Metropolitan University(香港都会大学)
Adverse weather conditions such as haze, rain, and snow often impair the quality of captured images, causing detection networks trained on normal images to generalize poorly in these scenarios. In this paper, we raise an intriguing question - if the combination of image restoration and object detection, can boost the performance of cutting-edge detectors in adverse weather conditions. To answer it, we propose an effective yet unified detection paradigm that bridges these two subtasks together via dynamic enhancement learning to discern objects in adverse weather conditions, called TogetherNet.…
Power Line Aerial Image Restoration under dverse Weather: Datasets and Baselines
School of Electrical Engineering and Automation, Nantong University(南通大学电气工程及其自动化学院);School of Artificial Intelligence and Computer Science, Nantong University(南通大学人工智能与计算机科学学院);School of Information Science and Technology, Nantong University(南通大学信息科学与技术学院);College of Computer and Software Engineering, Hohai University(河海大学计算机与软件学院);School of Electronic and Information Engineering, Suzhou University of Science and Technology(苏州科技大学电子与信息工程学院);School of Information and Communication Technology, Griffith University(格里菲斯大学信息与通信技术学院)
When Color-Space Decoupling Meets Diffusion for Adverse-Weather Image Restoration
School of Computer Science and Engineering, Nanjing University of Science and Technology(计算机科学与工程学院,南京理工大学);School of Electrical Engineering, Southeast University(电气工程学院,东南大学);School of Intelligence Science and Technology, Nanjing University(智能科学与技术学院,南京大学)
WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression
Guangdong University of Technology(广东工业大学);Sanda University(上海杉达学院);University of Queensland(昆士兰大学);Shenzhen MSU-BIT University(深圳北理莫斯科大学);Zhejiang college of Security Technology(浙江安防职业技术学院);Northwest China Research Institute of Electronic Equipment(西北电子设备研究所);Shenzhen Research Institute of Big Data(深圳市大数据研究院);Shenzhen University(深圳大学);Misr Higher Institute for Commerce and Computers(米斯尔商业与计算机高等学院)
Modern applications such as self-driving cars and drones rely heavily upon robust object detection techniques. However, weather corruptions can hinder the object detectability and pose a serious threat to their navigation and reliability. Thus, there is a need for efficient denoising, deraining, and restoration techniques. Generative adversarial networks and transformers have been widely adopted for image restoration. However, the training of these methods is often unstable and time-consuming. Furthermore, when used for object detection (OD), the output images generated by these methods may pr…
Jimei University(集美大学);Southwest University(西南大学);China University of Petroleum(中国石油大学)
Removing adverse weather conditions like rain, fog, and snow from images is a challenging problem. Although the current recovery algorithms targeting a specific condition have made impressive progress, it is not flexible enough to deal with various degradation types. We propose an efficient and compact image restoration network named DAN-Net (Degradation-Adaptive Neural Network) to address this problem, which consists of multiple compact expert networks with one adaptive gated neural. A single expert network efficiently addresses specific degradation in nasty winter scenes relying on the compa…
Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration
Samsung AI Center Cambridge(三星剑桥人工智能中心);National Taiwan University(国立台湾大学);Technical University of Iasi(雅西科技大学);Chang Gung University(长庚大学);University of Wurzburg(维尔茨堡大学);Queen Mary University of London(伦敦玛丽女王大学)
DA2Diff: Exploring Degradation-aware Adaptive Diffusion Priors for All-in-One Weather Restoration
School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);Collaborative Innovation Center of Novel Software Technology and Industrialization(新型软件技术与产业化协同创新中心);College of Computer Science and Technology, Anhui University of Technology(安徽工业大学计算机科学与技术学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
Fractal-IR: A Unified Framework for Efficient and Scalable Image Restoration
ETH Zürich(苏黎世联邦理工学院);University of Pisa(比萨大学);University of Trento(特伦托大学);Meta Reality Labs(元宇宙现实实验室);Peking University(北京大学);University of California, Merced(加州大学默塞德分校)
Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network
School of Automation, Southeast University(东南大学自动化学院);Chair of Robotics, Artificial Intelligence and Real-time Systems, Technical University of Munich(慕尼黑工业大学机器人、人工智能与实时系统讲席教授组)
Restoring Vision in Hazy Weather with Hierarchical Contrastive Learning
Nanjing University(南京大学);Memorial University of Newfoundland(纽芬兰纪念大学);Australian National University(澳大利亚国立大学);Sun Yat-sen University(中山大学);Wenzhou University(温州大学)
6thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preserving
Harbin Institute of Technology(哈尔滨工业大学);Nanjing University of Science and Technology(南京理工大学);National University of Defense Technology(国防科技大学);Shandong Normal University(山东师范大学);Qilu University of Technology(齐鲁工业大学)
Existing approaches for restoring weather-degraded images follow a fully-supervised paradigm and they require paired data for training. However, collecting paired data for weather degradations is extremely challenging, and existing methods end up training on synthetic data. To overcome this issue, we describe an approach for supervising deep networks that are based on CycleGAN, thereby enabling the use of unlabeled real-world data for training. Specifically, we introduce new losses for training CycleGAN that lead to more effective training, resulting in high-quality reconstructions. These new …
CSE, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);SISE, Shandong Normal University(山东师范大学信息科学与工程学院)
The exposed cameras of UAV can shake, shift, or even malfunction under the influence of harsh weather, while the add-on devices (Dupont lines) are very vulnerable to damage. We can place a low-cost T-OLED overlay around the camera to protect it, but this would also introduce image degradation issues. In particular, the temperature variations in the atmosphere can create mist that adsorbs to the T-OLED, which can cause secondary disasters (i.e., more severe image degradation) during the UAV's filming process. To solve the image degradation problem caused by overlaying T-OLEDs, in this paper we …
CoRE-UIR: Prior-guided common and residual experts for efficient all-in-one remote sensing image restoration
School of Geodesy and Geomatics, Wuhan University(武汉大学测绘学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院);State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(武汉大学测绘遥感信息工程国家重点实验室)
Restoring Images in Adverse Weather Conditions via Histogram Transformer
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络空间安全学院);Guangdong Provincial Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室);Wechat Business Group, Tencent(腾讯微信事业群)
Unified Restoration-Perception Learning: Maritime Infrared-Visible Image Fusion and Segmentation
Laboratory of Underwater Acoustic Communication and Marine Information Technology, Ministry of Education, Xiamen University(厦门大学水声通信与海洋信息技术教育部重点实验室);PAMI Research Group, Department of Computer and Information Science, University of Macau(澳门大学计算机与信息科学系PAMI研究组);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络空间安全学院)
Degradation-Aware Adaptive Context Gating for Unified Image Restoration
School of Computing and Artificial Intelligence, Southwest Jiaotong University(计算机与人工智能学院,西南交通大学);Institute for Infocomm Research, Agency for Science, Technology and Research(信息通信研究院,科技研究局);School of Computing and Artificial Intelligence, Jiangxi University of Finance and Economics(计算机与人工智能学院,江西财经大学);School of Information Management, Jiangxi University of Finance and Economics(信息管理学院,江西财经大学);Engineering Research Center of Sustainable Urban Intelligent Transportation, Ministry of Education(可持续智慧城市交通工程研究中心,教育部);National Engineering Laboratory of Integrated Transportation Big Data Application Technology, Southwest Jiaotong University(综合交通运输大数据应用技术国家工程实验室,西南交通大学)
ResLPR: A LiDAR Data Restoration Network and Benchmark for Robust Place Recognition Against Weather Corruptions
College of Intelligence Science and Technology(智能科学与技术学院);National University of Defense Technology(国防科技大学);Harbin Institute of Technology(哈尔滨工业大学);New York University Abu Dhabi(纽约大学阿布扎比分校);University of Science and Technology of China(中国科学技术大学)
In recent years, convolutional neural network-based single image adverse weather removal methods have achieved significant performance improvements on many benchmark datasets. However, these methods require large amounts of clean-weather degraded image pairs for training, which is often difficult to obtain in practice. Although various weather degradation synthesis methods exist in the literature, the use of synthetically generated weather degraded images often results in sub-optimal performance on the real weather degraded images due to the domain gap between synthetic and real-world images. …
All-weather Multi-Modality Image Fusion: Unified Framework and 100k Benchmark
Guangdong-HongKong-Macao Joint Laboratory for Intelligent MicroNano Optoelectronic Technology(粤港澳联合智能微纳光电子技术实验室);School of Physics and Optoelectronic Engineering, Foshan University(佛山大学物理与光电工程学院);Guangdong Provincial Key Laboratory of Industrial Intelligent Inspection Technology(广东省工业智能检测技术重点实验室);School of Instrumentation and Optoelectronic Engineering, Beihang University(北京航空航天大学仪器与光电工程学院);School of Information Engineering and Automation, Kunming University of Science and Technology(昆明理工大学信息工程与自动化学院);School of Artificial Intelligence, Optics and Electronics (i0PEN), School of Computer Science, Northwestern Polytechnical University(人工智能、光学与电子学院(i0PEN),西北工业大学计算机学院)
Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removal
School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机科学与信息工程学院);School of Information and Communication Engineering, University of Electronic Science and Technology of China(电子科技大学信息与通信工程学院);School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院)