In the real world, the degradation of images taken under haze can be quite complex, where the spatial distribution of haze is varied from image to image. Recent methods adopt deep neural networks to recover clean scenes from hazy images directly. However, due to the paradox caused by the variation of real captured haze and the fixed degradation parameters of the current networks, the generalization ability of recent dehazing methods on real-world hazy images is not ideal.To address the problem of modeling real-world haze degradation, we propose to solve this problem by perceiving and modeling density for uneven haze distribution. We propose a novel Separable Hybrid Attention (SHA) module to encode haze density by capturing features in the orthogonal directions to achieve this goal. Moreover, a density map is proposed to model the uneven distribution of the haze explicitly. The density map generates positional encoding in a semi-supervised way. Such a haze density perceiving and modeling capture the unevenly distributed degeneration at the feature level effectively. Through a suitable combination of SHA and density map, we design a novel dehazing network architecture, which achieves a good complexity-performance trade-off. The extensive experiments on two large-scale datasets demonstrate that our method surpasses all state-of-the-art approaches by a large margin both quantitatively and qualitatively, boosting the best published PSNR metric from 28.53 dB to 33.49 dB on the Haze4k test dataset and from 37.17 dB to 38.41 dB on the SOTS indoor test dataset.
In recent years, single image dehazing models (SIDM) based on atmospheric scattering model (ASM) have achieved remarkable results. However, it is noted that ASM-based SIDM degrades its performance in dehazing real world hazy images due to the limited modelling ability of ASM where the atmospheric light factor (ALF) and the angular scattering coefficient (ASC) are assumed as constants for one image. Obviously, the hazy images taken in real world cannot always satisfy this assumption. Such generating modelling mismatch between the real-world images and ASM sets up the upper bound of trained ASM-…
Peking University(北京大学);Peng Cheng Laboratory(鹏城实验室);South China University of Technology(华南理工大学)
In recent years, single image dehazing deep models based on Atmospheric Scattering Model (ASM) have achieved remarkable results. But the dehazing outputs of those models suffer from color shift. Analyzing the ASM model shows that the atmospheric light factor (ALF) is set as a scalar which indicates ALF is constant for whole image. However, for images taken in real-world, the illumination is not uniformly distributed over whole image which brings model mismatch and possibly results in color shift of the deep models using ASM. Bearing this in mind, in this study, first, a new non-homogeneous atm…
University of Waterloo(滑铁卢大学);Beijing Institute of Technology(北京理工大学);Xidian University(西安电子科技大学);Cardiff University(卡迪夫大学)
Image dehazing aims to restore spatial details from hazy images. There have emerged a number of image dehazing algorithms, designed to increase the visibility of those hazy images. However, much less work has been focused on evaluating the visual quality of dehazed images. In this paper, we propose a Reduced-Reference dehazed image quality evaluation approach based on Partial Discrepancy (RRPD) and then extend it to a No-Reference quality assessment metric with Blind Perception (NRBP). Specifically, inspired by the hierarchical characteristics of the human perceiving dehazed images, we introdu…
Shanxi University(山西大学);The Institute of Computer Science and Technology, Peking University(北京大学计算机科学技术研究所);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所信息安全国家重点实验室)
The formulation of the hazy image is mainly dominated by the reflected lights and ambient airlight. Existing dehazing methods often ignore the depth cues and fail in distant areas where heavier haze disturbs the visibility. However, we note that the guidance of the depth information for transmission estimation could remedy the decreased visibility as distances increase. In turn, the good transmission estimation could facilitate the depth estimation for hazy images. In this paper, a deep end-to-end model that iteratively estimates image depths and transmission maps is proposed to perform an eff…
RSDehamba: Lightweight Vision Mamba for Remote Sensing Satellite Image Dehazing
College of Electronic Information Engineering, Shenyang Aerospace University(沈阳航空航天大学电子信息工程学院);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);School of Basic Sciences for Aviation, Naval Aviation University(海军航空大学航空基础学院)
Laplace-Mamba: Laplace Frequency Prior-Guided Mamba-CNN Fusion Network for Image Dehazing
School of Computer Science and Technology, Anhui University of Technology(安徽理工大学计算机科学与技术学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);College of Artificial Intelligence, Taiyuan University of Technology(太原科技大学人工智能学院)
Efficient Dual-domain Image Dehazing with Haze Prior Perception
Institute of Intelligent Information Processing, Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen Key Laboratory of Modern Communications and Information Processing, Shenzhen University(智能信息处理研究院);College of Engineering and Computer Science, Australian National University(工程与计算机科学学院)
Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Network
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Sun Yat-sen University(中山大学);Duke University(杜克大学);Shanghai Jiao Tong University(上海交通大学);The Chinese University of Hong Kong(香港中文大学);Meta Reality Labs(元宇宙现实实验室)
Fourier-RWKV: A Multi-State Perception Network for Efficient Image Dehazing
Institute of Intelligent Information Processing, Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen Key Laboratory of Modern Communications and Information Processing, Shenzhen University(智能信息处理研究院);College of Engineering and Computer Science, Australian National University(工程与计算机科学学院)
Hangzhou Dianzi University(杭州电子科技大学);University of Science and Technology of China(中国科学技术大学);University at Buffalo, The State University of New York(纽约州立大学布法罗分校)
Modeling statistical regularity plays an essential role in ill-posed image processing problems. Recently, deep learning based methods have been presented to implicitly learn statistical representation of pixel distributions in natural images and leverage it as a constraint to facilitate subsequent tasks, such as color constancy and image dehazing. However, the existing CNN architecture is prone to variability and diversity of pixel intensity within and between local regions, which may result in inaccurate statistical representation. To address this problem, this paper presents a novel fully po…
Remote Sensing Image Dehazing: A Systematic Review of Progress, Challenges, and Prospects
School of Artificial Intelligence and Computer Science(人工智能与计算机科学学院);Josef Kittler Research Institute on Artificial Intelligence(乔塞夫·基特勒人工智能研究所);School of Electronic Engineering(电子工程学院);College of Artificial Intelligence(人工智能学院);Aerospace Information Research Institute(航天信息研究所);Department of Computer Science(计算机科学系)
Variational Deep Unfolding with Mamba-Based Nonlocal Modeling for Underwater Image Enhancement
Institute of Applied Computing and Community Code (IAC3)(应用计算与社区代码研究所 (IAC3));Dept. of Mathematics and Computer Science, Universitat de les Illes Balears(巴利阿里群岛大学数学与计算机科学系)
Recently, image restoration transformers have achieved comparable performance with previous state-of-the-art CNNs. However, how to efficiently leverage such architectures remains an open problem. In this work, we present Dual-former whose critical insight is to combine the powerful global modeling ability of self-attention modules and the local modeling ability of convolutions in an overall architecture. With convolution-based Local Feature Extraction modules equipped in the encoder and the decoder, we only adopt a novel Hybrid Transformer Block in the latent layer to model the long-distance d…
Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology(华中科技大学武汉光电国家实验室);Microsoft Research(微软研究院);Texas A&M University(德克萨斯A&M大学)
The recent development of CNN-based image dehazing has revealed the effectiveness of end-to-end modeling. However, extending the idea to end-to-end video dehazing has not been explored yet. In this paper, we propose an End-to-End Video Dehazing Network (EVD-Net), to exploit the temporal consistency between consecutive video frames. A thorough study has been conducted over a number of structure options, to identify the best temporal fusion strategy. Furthermore, we build an End-to-End United Video Dehazing and Detection Network(EVDD-Net), which concatenates and jointly trains EVD-Net with a vid…
Fi-Gaussian: Frequency-Aware Implicit Gaussian Splatting for Single Image Dehazing
College of Mechanical and Vehicle Engineering, Chongqing University(重庆大学机械与车辆工程学院);Department of Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程系);National Innovation Center of Intelligent and Connected Vehicles(国家智能网联汽车创新中心);School of Vehicle and Mobility, Tsinghua University(清华大学车辆与运载学院)
Joint multi-dimensional dynamic attention and transformer for general image restoration
School of Information Engineering, Guangdong University of Technology(广东工业大学信息工程学院);Key Laboratory of Photonic Technology for Integrated Sensing and Communication, Ministry of Education(教育部光子技术集成感知与通信重点实验室);Guangdong Provincial Key Laboratory of Information Photonics Technology(广东省信息光子技术重点实验室);Institute of Advanced Photonics Technology, School of Information Engineering, Guangdong University of Technology(广东工业大学信息工程学院先进光子技术研究所);School of Electronics and Communication Engineering, Sun Yat-Sen University(中山大学电子与通信工程学院)
Multi-dimensional Visual Prompt Enhanced Image Restoration via Mamba-Transformer Aggregation
School of Digital Industry, Jiangxi Normal University(江西师范大学数字产业学院);School of Computer and Information Engineering, Jiangxi Normal University(江西师范大学计算机与信息工程学院)
HDMba: Hyperspectral Remote Sensing Imagery Dehazing with State Space Model
College of Oceanography and Space Informatics, China University of Petroleum (East China)(中国石油大学(华东)海洋与空间信息学院);National Subsea Centre, Robert Gordon University(罗伯特戈登大学国家海底中心);Helmholtz Institute Freiberg for Resource Technology, Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心亥姆霍兹弗赖贝格资源技术研究所)
Underwater Variable Zoom: Depth-Guided Perception Network for Underwater Image Enhancement
School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院);University of New South Wales(新南威尔士大学);School of Computer Science and Technology, Shandong Technology and Business University(山东工商学院计算机科学与技术学院);School of Information and Communication Engineering, Dalian Minzu University(大连民族大学信息与通信工程学院);School of Innovation Experiment, Dalian University of Technology(大连理工大学创新实验学院)
Tsinghua University(清华大学);Nanjing University(南京大学);National University of Singapore (Suzhou) Research Institute(新加坡国立大学(苏州)研究院)
Many aesthetic models in computer vision suffer from two shortcomings: 1) the low descriptiveness and interpretability of those hand-crafted aesthetic criteria (i.e., nonindicative of region-level aesthetics), and 2) the difficulty of engineering aesthetic features adaptively and automatically toward different image sets. To remedy these problems, we develop a deep architecture to learn aesthetically-relevant visual attributes from Flickr1, which are localized by multiple textual attributes in a weakly-supervised setting. More specifically, using a bag-ofwords (BoW) representation of the frequ…
German Aerospace Center(德国航空航天中心);Technical University of Munich(慕尼黑工业大学)
Multi-label classification plays a momentous role in perceiving intricate contents of an aerial image and triggers several related studies over the last years. However, most of them deploy few efforts in exploiting label relations, while such dependencies are crucial for making accurate predictions. Although an LSTM layer can be introduced to modeling such label dependencies in a chain propagation manner, the efficiency might be questioned when certain labels are improperly inferred. To address this, we propose a novel aerial image multi-label classification network, attention-aware label rela…