Underwater images are altered by the physical characteristics of the medium through which light rays pass before reaching the optical sensor. Scattering and wavelength-dependent absorption significantly modify the captured colors depending on the distance of observed elements to the image plane. In this paper, we aim to recover an image of the scene as if the water had no effect on light propagation. We introduce SUCRe, a novel method that exploits the scene's 3D structure for underwater color restoration. By following points in multiple images and tracking their intensities at different distances to the sensor, we constrain the optimization of the parameters in an underwater image formation model and retrieve unattenuated pixel intensities. We conduct extensive quantitative and qualitative analyses of our approach in a variety of scenarios ranging from natural light to deep-sea environments using three underwater datasets acquired from real-world scenarios and one synthetic dataset. We also compare the performance of the proposed approach with that of a wide range of existing state-of-the-art methods. The results demonstrate a consistent benefit of exploiting multiple views across a spectrum of objective metrics. Our code is publicly available at https://github.com/clementinboittiaux/sucre.
TIDE: Two-Stage Inverse Degradation Estimation with Guided Prior Disentanglement for Underwater Image Restoration
Mohamed bin Zayed University of AI(莫扎德·本·泽亚德人工智能大学);University of Amsterdam(阿姆斯特丹大学);University of Massachusetts, Amherst(马萨诸塞大学阿默斯特分校);Nagasaki University(长崎大学)
A Generative Data Framework with Authentic Supervision for Underwater Image Restoration and Enhancement
Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信);Department of Automation, Shanghai Jiao Tong University(自动化系,上海交通大学);School of Artificial Intelligence, Optics and ElectroNics (iOPEN), Northwestern Polytechnical University(人工智能、光学与电子学学院(iOPEN),西北工业大学);Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences(西安光学精密机械研究所,中国科学院)
UniV2D: Bridging Visual Restoration and Semantic Perception for Underwater Salient Object Detection
School of Computer Science, Wuhan University(武汉大学计算机学院);School of Computer Science, The University of Sydney(悉尼大学计算机学院);School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院)
Underwater Image Restoration via Contrastive Learning and a Real-world Dataset
Commonwealth Scientific and Industrial Research Organisation (CSIRO)(澳大利亚联邦科学与工业研究组织);Australian National University(澳大利亚国立大学)
水下图像复原对于揭示水下世界具有重要意义。在过去的几十年中,已经开发了许多技术和算法。然而,由于基本的困难与成像/传感,照明和折射几何失真,在捕捉清晰的水下图像,没有进行全面的评估水下图像恢复。为了解决这一差距,我们构建了一个大规模的真实水下图像数据集,称为“Heron Island Coral Reef Dataset”(苍鹭岛珊瑚礁数据集),目的是对现有方法进行基准测试,并支持开发新的基于深度学习的方法。我们采用准确的水参数(漫衰减系数)在生成参考图像。在非配对训练集中,有2000幅参考恢复图像和6003幅原始水下图像。此外,我们提出了一种新的方法,用于水下图像恢复的基础上无监督的图像到图像的翻译框架。我们提出的方法利用对比学习和生成对抗网络来最大化原始图像和恢复图像之间的互信息。与最近的方法进行比较的广泛实验进一步证明了我们所提出的方法的优越性。我们的代码和数据集在GitHub上公开。
UniUIR: Considering Underwater Image Restoration as An All-in-One Learner
National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University(国家多媒体软件工程研究中心,计算机学院,武汉大学);School of Information Engineering, Guangdong University of Technology(信息工程学院,广东工业大学);Horizon Robotics
An Experimental-based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging
Academy for Engineering & Technology, Fudan University(复旦大学工程与应用技术研究院);College of Information Technology, Shanghai Ocean University(上海海洋大学信息学院);University of Calabria(卡拉布里亚大学);School of Computer Science, Fudan University(复旦大学计算机科学学院);Napier Edinburgh University(爱丁堡龙比亚大学)
Underwater Image Restoration via Polymorphic Large Kernel CNNs
University of Macau(澳门大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shenzhen Polytechnic University(深圳职业技术大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Fuzhou University(福州大学);University of Chinese Academy of Sciences(中国科学院大学);Peking University(北京大学)
Dual High-Order Total Variation Model for Underwater Image Restoration
College of Computer Science and Technology, Qingdao University(青岛大学计算机科学与技术学院);Key Laboratory of Knowledge Automation for Industrial Processes, Ministry of Education, the School of Automation and Electrical Engineering, University of Science and Technology Beijing(北京科技大学自动化与电气工程学院 工业过程知识自动化教育部重点实验室)
Reveal of Domain Effect: How Visual Restoration Contributes to Object Detection in Aquatic Scenes
State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences(复杂系统管理与控制国家重点实验室,中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Mechanical Engineering and Automation, Beihang University(北京航空航天大学机械工程及自动化学院)
Underwater Image Restoration Through a Prior Guided Hybrid Sense Approach and Extensive Benchmark Analysis
University of Macau(澳门大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);School of Big Data, Baoshan University(保山学院大数据学院);School of Computer Science and Engineering, Huizhou University(惠州学院计算机科学与工程学院)
提出 Color Balance Prior 引导的多尺度混合感知框架 GuidedHybSensUIR,并构建综合水下复原基准,实验显示其总体优于37种现有方法。
Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting
School of Software, Dalian University of Technology(大连理工大学软件学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
Towards Real-Time Advancement of Underwater Visual Quality with GAN
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Beijing Innovation Center for Engineering Science and Advanced Technology, Peking University(北京大学工程科学与先进技术北京创新中心);Beihang University(北京航空航天大学)
Underwater Optical Image Processing: A Comprehensive Review
Kyushu Institute of Technology(九州工业大学);Chinese Academy of Science(中国科学院);Yangzhou University(扬州大学);Nanjing Normal University(南京师范大学);Huazhong University of Science and Technology(华中科技大学)
Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancement
School of Intelligence Science and Technology, Nanjing University(智能科学与技术学院,南京大学);School of Artificial Intelligence, Nanjing Normal University(人工智能学院,南京师范大学)