Caused by the difference of data distributions, intra-domain gap and inter-domain gap are widely present in image processing tasks. In the field of image dehazing, certain previous works have paid attention to the inter-domain gap between the synthetic domain and the real domain. However, those methods only establish the connection from the source domain to the target domain without taking into account the large distribution shift within the target domain (intra-domain gap). In this work, we propose a Two-Step Dehazing Network (TSDN) with an intra-domain adaptation and a constrained inter-domain adaptation. First, we subdivide the distributions within the synthetic domain into subsets and mine the optimal subset (easy samples) by loss-based supervision. To alleviate the intra-domain gap of the synthetic domain, we propose an intra-domain adaptation to align distributions of other subsets to the optimal subset by adversarial learning. Finally, we conduct the constrained inter-domain adaptation from the real domain to the optimal subset of the synthetic domain, alleviating the domain shift between domains as well as the distribution shift within the real domain. Extensive experimental results demonstrate that our framework performs favorably against the state-of-the-art algorithms both on the synthetic datasets and the real datasets.
ETH Zurich(苏黎世联邦理工学院);Merantix GmbH(梅兰蒂克斯有限公司);MEO, Universitatea Politehnica Timisoara(蒂米什瓦拉理工大学MEO);ICTEAM, Universite Catholique de Louvain(鲁汶天主教大学ICTEAM)
Haze removal or dehazing is a challenging ill-posed problem that has drawn a significant attention in the last few years. Despite this growing interest, the scientific community is still lacking a reference dataset to evaluate objectively and quantitatively the performance of proposed dehazing methods. The few datasets that are currently considered, both for assessment and training of learning-based dehazing techniques, exclusively rely on synthetic hazy images. To address this limitation, we introduce the first outdoor scenes database (named O-HAZE) composed of pairs of real hazy and correspo…
We propose an enhanced multi-scale network, dubbed GridDehazeNet+, for single image dehazing. The proposed dehazing method does not rely on the Atmosphere Scattering Model (ASM), and an explanation as to why it is not necessarily performing the dimension reduction offered by this model is provided. GridDehazeNet+ consists of three modules: pre-processing, backbone, and post-processing. The trainable pre-processing module can generate learned inputs with better diversity and more pertinent features as compared to those derived inputs produced by hand-selected pre-processing methods. The backbon…
Shenzhen University(深圳大学);Australian National University(澳大利亚国立大学);Tencent(腾讯)
Hazy images reduce the visibility of the image content, and haze will lead to failure in handling subsequent computer vision tasks. In this paper, we address the problem of image dehazing by proposing a dehazing network named T-Net, which consists of a backbone network based on the U-Net architecture and a dual attention module. And it can achieve multi-scale feature fusion by using skip connections with a new fusion strategy. Furthermore, by repeatedly unfolding the plain T-Net, Stack T-Net is proposed to take advantage of the dependence of deep features across stages via a recursive strategy…
Universitatea Politehnica Timisoara(蒂米什瓦拉理工大学);University of Girona(赫罗纳大学);ETH Zurich(苏黎世联邦理工学院)
Single image dehazing is an ill-posed problem that has recently drawn important attention. Despite the significant increase in interest shown for dehazing over the past few years, the validation of the dehazing methods remains largely unsatisfactory, due to the lack of pairs of real hazy and corresponding haze-free reference images. To address this limitation, we introduce Dense-Haze - a novel dehazing dataset. Characterized by dense and homogeneous hazy scenes, Dense-Haze contains 33 pairs of real hazy and corresponding haze-free images of various outdoor scenes. The hazy scenes have been rec…
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Adobe Inc.(奥多比公司)
Recently, convolutional neural networks (CNNs) have achieved great improvements in single image dehazing and attained much attention in research. Most existing learning-based dehazing methods are not fully end-to-end, which still follow the traditional dehazing procedure: first estimate the medium transmission and the atmospheric light, then recover the haze-free image based on the atmospheric scattering model. However, in practice, due to lack of priors and constraints, it is hard to precisely estimate these intermediate parameters. Inaccurate estimation further degrades the performance of de…
State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院虚拟现实技术与系统国家重点实验室);Key Laboratory of Solar Activity, National Astronomical Observatories, Chinese Academy of Sciences(中国科学院国家天文台太阳活动重点实验室);Peng Cheng Laboratory(鹏城实验室)
Conventional CNNs-based dehazing models suffer from two essential issues: the dehazing framework (limited in interpretability) and the convolution layers (content-independent and ineffective to learn long-range dependency information). In this paper, firstly, we propose a new complementary feature enhanced framework, in which the complementary features are learned by several complementary subtasks and then together serve to boost the performance of the primary task. One of the prominent advantages of the new framework is that the purposively chosen complementary tasks can focus on learning wea…
East China Normal University(华东师范大学);Jiangxi Normal University(江西师范大学)
Single image dehazing is a challenging ill-posed problem that has drawn significant attention in the last few years. Recently, convolutional neural networks have achieved great success in image dehazing. However, it is still difficult for these increasingly complex models to recover accurate details from the hazy image. In this paper, we pay attention to the feature extraction and utilization of the input image itself. To achieve this, we propose a Multi-scale Topological Network (MSTN) to fully explore the features at different scales. Meanwhile, we design a Multi-scale Feature Fusion Module …
Zhongnan University of Economics and Law(中南财经政法大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Yunnan University(云南大学);National Institute of Natural Hazards, Ministry of Emergency Management of China(中国应急管理部国家自然灾害防治研究院);Wuhan University(武汉大学)
Existing approaches towards single image dehazing including both model-based and learning-based heavily rely on the estimation of so-called transmission maps. Despite its conceptual simplicity, using transmission maps as an intermediate step often makes it more difficult to optimize the perceptual quality of reconstructed images. To overcome this weakness, we propose a direct deep learning approach toward image dehazing bypassing the step of transmission map estimation and facilitating end-to-end perceptual optimization. Our technical contributions are mainly three-fold. First, based on the an…
Single image dehazing, which aims to recover the clear image solely from an input hazy or foggy image, is a challenging ill-posed problem. Analysing existing approaches, the common key step is to estimate the haze density of each pixel. To this end, various approaches often heuristically designed haze-relevant features. Several recent works also automatically learn the features via directly exploiting Convolutional Neural Networks (CNN). However, it may be insufficient to fully capture the intrinsic attributes of hazy images. To obtain effective features for single image dehazing, this paper p…
East China University of Science and Technology(华东理工大学);Tongji University(同济大学);Shanghai Institute of Intelligent Science and Technology(上海智能科学与技术研究院)
Learning-based image dehazing methods are essential to assist autonomous systems in enhancing reliability. Due to the domain gap between synthetic and real domains, the internal information learned from synthesized images is usually sub-optimal in real domains, leading to severe performance drop of dehaizing models. Driven by the ability on exploring internal information from a few unseen-domain samples, meta-learning is commonly adopted to address this issue via test-time training, which is hyperparameter-sensitive and time-consuming. In contrast, we present a domain generalization framework …
CLIP-Guided Data Augmentation for Night-Time Image Dehazing
Hangzhou Dianzi University(杭州电子科技大学);Jinan University(济南大学);Hefei University of Technology(合肥工业大学);Wuhan University(武汉大学);The University of Tokyo(东京大学)
School of Computer and Information Technology, Shanxi University(山西大学计算机与信息技术学院);Institute of Computer Science and Technology, Peking University(北京大学计算机科学技术研究所);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所)
The recent physical model-free dehazing methods have achieved state-of-the-art performances. However, without the guidance of physical models, the performances degrade rapidly when applied to real scenarios due to the unavailable or insufficient data problems. On the other hand, the physical model-based methods have better interpretability but suffer from multi-objective optimizations of parameters, which may lead to sub-optimal dehazing results. In this paper, a progressive residual learning strategy has been proposed to combine the physical model-free dehazing process with reformulated scatt…
This paper proposes a novel technique for single image dehazing. Most of the state-of-the-art methods for single image dehazing relies either on Dark Channel Prior (DCP) or on Color line. The proposed method combines the two different approaches. We initially compute the dark channel prior and then apply a Nearest-Neighbor (NN) based regularization technique to obtain a smooth transmission map of the hazy image. We consider the effect of airlight on the image by using the color line model to assess the commitment of airlight in each patch of the image and interpolate at the local neighborhood …
Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院)
Presence of haze in images obscures underlying information, which is undesirable in applications requiring accurate environment information. To recover such an image, a dehazing algorithm should localize and recover affected regions while ensuring consistency between recovered and its neighboring regions. However owing to fixed receptive field of convolutional kernels and non uniform haze distribution, assuring consistency between regions is difficult. In this paper, we utilize an encoder-decoder based network architecture to perform the task of dehazing and integrate an spatially aware channe…
Shandong Normal University(山东师范大学);Nanjing University of Science and Technology(南京理工大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室)
Currently, most single image dehazing models cannot run an ultra-high-resolution (UHD) image with a single GPU shader in real-time. To address the problem, we introduce the principle of infinite approximation of Taylor's theorem with the Laplace pyramid pattern to build a model which is capable of handling 4K hazy images in real-time. The N branch networks of the pyramid network correspond to the N constraint terms in Taylor's theorem. Low-order polynomials reconstruct the low-frequency information of the image (e.g. color, illumination). High-order polynomials regress the high-frequency infor…
Xi’an University of Technology(西安理工大学);Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences(中国科学院西安光学精密机械研究所)
Dehazing is in the image processing and computer vision communities, the task of enhancing the image taken in foggy conditions. To better understand this type of algorithm, we present in this document a dehazing method which is suitable for several local contrast adjustment algorithms. We base it on two filters. The first filter is built with a step of normalization with some other statistical tricks while the last represents the local contrast improvement algorithm. Thus, it can work on both CPU and GPU for real-time applications. We hope that our approach will open the door to new ideas in t…
Restoring Vision in Hazy Weather with Hierarchical Contrastive Learning
Nanjing University(南京大学);Memorial University of Newfoundland(纽芬兰纪念大学);Australian National University(澳大利亚国立大学);Sun Yat-sen University(中山大学);Wenzhou University(温州大学)
Dehaze-GaussianImage: Zero-Shot Dehazing via Efficient 2D Gaussian Splatting Representation
College of Mechanical and Vehicle Engineering, Chongqing University(重庆大学机械与车辆工程学院);Department of Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程系);National Innovation Center of Intelligent and Connected Vehicles(国家智能网联汽车创新中心);School of Vehicle and Mobility, Tsinghua University(清华大学车辆与运载学院)
MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazing
Sun Yat-sen University(中山大学);Australian National University(澳大利亚国立大学);Guangdong Provincial Key Laboratory of Robotics and Digital Intelligent Manufacturing Technology(广东省机器人与数字智能制造技术重点实验室)
Mutual Information-driven Triple Interaction Network for Efficient Image Dehazing
Hefei University of Technology(合肥工业大学);Intelligent Interconnected Systems Laboratory of Anhui Province(安徽省智能互联系统实验室);Guangxi Academy of Sciences(广西科学院);ETH Zürich(苏黎世联邦理工学院)
University of Minnesota(明尼苏达大学);National University of Singapore(新加坡国立大学)
Intra-class compactness and inter-class separability are crucial indicators to measure the effectiveness of a model to produce discriminative features, where intra-class compactness indicates how close the features with the same label are to each other and inter-class separability indicates how far away the features with different labels are. In this work, we investigate intra-class compactness and inter-class separability of features learned by convolutional networks and propose a Gaussian-based softmax ($\mathcal{G}$-softmax) function that can effectively improve intra-class compactness and …
WaveDH: Wavelet Sub-bands Guided ConvNet for Efficient Image Dehazing
Artificial Intelligence Graduate School, Gwangju Institute of Science and Technology (GIST)(光州科学技术院人工智能研究生院);School of Electronic Engineering, Xidian University(西安电子科技大学电子工程学院);School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology (GIST)(光州科学技术院电气与计算机工程学院)
6thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preserving
Harbin Institute of Technology(哈尔滨工业大学);Nanjing University of Science and Technology(南京理工大学);National University of Defense Technology(国防科技大学);Shandong Normal University(山东师范大学);Qilu University of Technology(齐鲁工业大学)
DPSF-Net: A Dual-Prior Spatial-Frequency Network for Real-World Remote Sensing Image Dehazing
School of Software Engineering, Jinling Institute of Technology(金陵科技学院软件工程学院);School of Information Engineering, Yancheng Institute of Technology(盐城工学院信息工程学院)
National University of Singapore(新加坡国立大学);Yale-NUS College(耶鲁-新加坡国大学院);Nanyang Technological University(南洋理工大学)
Few existing image defogging or dehazing methods consider dense and non-uniform particle distributions, which usually happen in smoke, dust and fog. Dealing with these dense and/or non-uniform distributions can be intractable, since fog's attenuation and airlight (or veiling effect) significantly weaken the background scene information in the input image. To address this problem, we introduce a structure-representation network with uncertainty feedback learning. Specifically, we extract the feature representations from a pre-trained Vision Transformer (DINO-ViT) module to recover the backgroun…
Bridging the Gap Between Image Restoration and Navigational Safety in Hazy Conditions: A New Visibility Estimation Metric for Maritime Surveillance
Sanya Science and Education Innovation Park, Wuhan University of Technology, Sanya 572000, China(武汉理工大学三亚科学教育创新园,三亚572000,中国);School of Navigation, Wuhan University of Technology, Wuhan 430063, China(武汉理工大学航海学院,武汉430063,中国);State Key Laboratory of Maritime Technology and Safety, Wuhan University of Technology, Wuhan 430063, China(武汉理工大学海洋技术与安全国家重点实验室,武汉430063,中国);Department of Mechanics and Maritime Sciences, Chalmers University of Technology, Göteborg 41296, Sweden(楚科奇大学机械与航海科学系,哥德堡41296,瑞典)
Carnegie Mellon University(卡内基梅隆大学);INESC TEC;Faculty of Engineering, University of Porto(波尔图大学工程学院)
We propose a pixel color amplification theory and family of enhancement methods to facilitate segmentation tasks on retinal images. Our novel re-interpretation of the image distortion model underlying dehazing theory shows how three existing priors commonly used by the dehazing community and a novel fourth prior are related. We utilize the theory to develop a family of enhancement methods for retinal images, including novel methods for whole image brightening and darkening. We show a novel derivation of the Unsharp Masking algorithm. We evaluate the enhancement methods as a pre-processing step…
Image optimization problems encompass many applications such as spectral fusion, deblurring, deconvolution, dehazing, matting, reflection removal and image interpolation, among others. With current image sizes in the order of megabytes, it is extremely expensive to run conventional algorithms such as gradient descent, making them unfavorable especially when closed-form solutions can be derived and computed efficiently. This paper explains in detail the framework for solving convex image optimization and deconvolution in the Fourier domain. We begin by explaining the mathematical background and…
State Key Laboratory of Virtual Reality Technology and Systems, SCSE, Beihang University(北京航空航天大学计算机学院虚拟现实技术与系统国家重点实验室);Peng Cheng Laboratory(鹏城实验室)
Person Re-Identification (Re-Id) in occlusion scenarios is a challenging problem because a pedestrian can be partially occluded. The use of local information for feature extraction and matching is still necessary. Therefore, we propose a Pose-guided inter-and intra-part relational transformer (Pirt) for occluded person Re-Id, which builds part-aware long-term correlations by introducing transformers. In our framework, we firstly develop a pose-guided feature extraction module with regional grouping and mask construction for robust feature representations. The positions of a pedestrian in the i…