arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.00736cs.CVcs.AIcs.LGcs.MM
收藏

扩散模型、图像超分辨率及其一切:综述

Diffusion Models, Image Super-Resolution And Everything: A Survey

German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau(莱茵兰-普法尔茨州 Kaiserslautern-Landau 工业大学)

Brian B. Moser, Arundhati S. Shanbhag, Federico Raue, Stanislav Frolov, Sebastian Palacio, Andreas Dengel

AI总结:

本综述系统梳理扩散模型在图像超分辨率中的理论基础、方法分类及当前挑战,并展望未来研究方向,以促进该领域的创新。

摘要:

扩散模型(DMs)已经颠覆了图像超分辨率(SR)领域,并进一步缩小了图像质量与人类感知偏好之间的差距。它们易于训练,能够生成质量非常高的样本,其逼真程度超过了以往生成方法所产出的样本。尽管结果令人期待,但它们也带来了需要进一步研究的新挑战:高计算需求、可比性、缺乏可解释性、颜色偏移等问题。不幸的是,由于出版物数量庞大,进入这一领域令人望而生畏。为解决这一问题,我们提供了应用于图像SR的扩散模型理论基础的一致性叙述,并提供了详细分析,强调了该领域内独特的特点和方法,这与该领域更广泛的现有综述不同。本综述阐明了扩散模型原理的连贯理解,并探讨了当前的研究途径,包括替代输入域、条件化技术、引导机制、退化空间和零样本学习方法。通过以扩散模型为视角详细审视图像SR的演变和当前趋势,本综述揭示了现有挑战并描绘了潜在未来方向,旨在激发这一快速发展领域的进一步创新。

英文摘要:

Diffusion Models (DMs) have disrupted the image Super-Resolution (SR) field and further closed the gap between image quality and human perceptual preferences. They are easy to train and can produce very high-quality samples that exceed the realism of those produced by previous generative methods. Despite their promising results, they also come with new challenges that need further research: high computational demands, comparability, lack of explainability, color shifts, and more. Unfortunately, entry into this field is overwhelming because of the abundance of publications. To address this, we provide a unified recount of the theoretical foundations underlying DMs applied to image SR and offer a detailed analysis that underscores the unique characteristics and methodologies within this domain, distinct from broader existing reviews in the field. This survey articulates a cohesive understanding of DM principles and explores current research avenues, including alternative input domains, conditioning techniques, guidance mechanisms, corruption spaces, and zero-shot learning approaches. By offering a detailed examination of the evolution and current trends in image SR through the lens of DMs, this survey sheds light on the existing challenges and charts potential future directions, aiming to inspire further innovation in this rapidly advancing area.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑