arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.15067cs.CVeess.IV

全能图像修复综述:分类、评估与未来趋势

A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends

School of Computer Science and Technology, Harbin Institute of Technology(计算机科学与技术学院,哈尔滨工业大学)

Junjun Jiang, Zengyuan Zuo, Gang Wu, Kui Jiang, Xianming Liu

AI总结:

本综述首次系统概述全能图像修复(AiOIR)领域,提供结构化分类法,整合数据集与评估协议,并总结开源模型以推动统一视觉修复系统的发展。

摘要:

图像修复(IR)旨在从由噪声、模糊、压缩和恶劣天气等多种因素导致的退化观测中恢复高质量图像。尽管传统IR方法通过针对单一退化类型取得了显著进展,但其专用性往往以牺牲泛化能力为代价,使其难以应对实际应用中遇到的多方面失真。为应对这一挑战,全能图像修复(AiOIR)范式近期应运而生,提供了一个能够熟练处理多种退化类型的统一框架。这些创新模型通过自适应学习特定退化特征,同时利用跨不同损坏的共享知识,增强了便利性和多功能性。在本综述中,我们首次对AiOIR进行了深入且系统的概述,提供了结构化的分类法,根据架构设计、学习范式及其核心创新对现有方法进行分类。我们系统地分类当前方法并评估这些模型面临的挑战,概述研究方向以推动这一快速发展的领域。为便于评估现有方法,我们还整合了广泛使用的数据集、评估协议和实现实践,并比较和总结了最先进的开源模型。作为首篇致力于AiOIR的全面综述,本文旨在描绘概念图景,综合主流技术,并激发对更智能、统一和适应性强的视觉修复系统的进一步探索。精选的代码仓库可在 https://github.com/Harbinzzy/All-in-One-Image-Restoration-Survey 获取。

英文摘要:

Image restoration (IR) seeks to recover high-quality images from degraded observations caused by a wide range of factors, including noise, blur, compression, and adverse weather. While traditional IR methods have made notable progress by targeting individual degradation types, their specialization often comes at the cost of generalization, leaving them ill-equipped to handle the multifaceted distortions encountered in real-world applications. In response to this challenge, the all-in-one image restoration (AiOIR) paradigm has recently emerged, offering a unified framework that adeptly addresses multiple degradation types. These innovative models enhance the convenience and versatility by adaptively learning degradation-specific features while simultaneously leveraging shared knowledge across diverse corruptions. In this survey, we provide the first in-depth and systematic overview of AiOIR, delivering a structured taxonomy that categorizes existing methods by architectural designs, learning paradigms, and their core innovations. We systematically categorize current approaches and assess the challenges these models encounter, outlining research directions to propel this rapidly evolving field. To facilitate the evaluation of existing methods, we also consolidate widely-used datasets, evaluation protocols, and implementation practices, and compare and summarize the most advanced open-source models. As the first comprehensive review dedicated to AiOIR, this paper aims to map the conceptual landscape, synthesize prevailing techniques, and ignite further exploration toward more intelligent, unified, and adaptable visual restoration systems. A curated code repository is available at https://github.com/Harbinzzy/All-in-One-Image-Restoration-Survey.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑