arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.00334cs.CVcs.LG

用于图像超分辨率的四元数小波条件扩散模型

Quaternion Wavelet-Conditioned Diffusion Models for Image Super-Resolution

Dept. Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome(信息工程、电子与电信系,罗马萨皮恩扎大学)

Luigi Sigillo, Christian Bianchi, Aurelio Uncini, Danilo Comminiello

AI总结:

本文提出ResQu框架,将四元数小波预处理与潜在扩散模型结合,并引入四元数小波和时间感知编码器动态增强条件化过程,在图像超分辨率任务中取得了优于现有方法的感知质量与评估指标。

摘要:

图像超分辨率是计算机视觉中的一个基本问题,其应用范围广泛,从医学成像到卫星分析。从低分辨率输入重建高分辨率图像的能力对于增强下游任务(如目标检测和分割)至关重要。虽然深度学习已显著推进了超分辨率的发展,但实现具有细粒度细节和逼真纹理的高质量重建仍然具有挑战性,尤其是在高放大倍数下。最近利用扩散模型的方法已展示出有前景的结果,但它们往往难以在感知质量与结构保真度之间取得平衡。在这项工作中,我们提出了ResQu,这是一种新颖的超分辨率框架,它将四元数小波预处理框架与潜在扩散模型相结合,并引入了一种新的四元数小波和时间感知编码器。与先前在扩散模型中简单应用小波变换的方法不同,我们的方法通过利用四元数小波嵌入来增强条件化过程,这些嵌入在去噪的不同阶段被动态集成。此外,我们还利用了基础模型(如Stable Diffusion)的生成先验。在特定领域数据集上的大量实验表明,我们的方法取得了出色的超分辨率结果,在许多情况下在感知质量和标准评估指标上优于现有方法。代码将在修订过程后提供。

英文摘要:

Image Super-Resolution is a fundamental problem in computer vision with broad applications spacing from medical imaging to satellite analysis. The ability to reconstruct high-resolution images from low-resolution inputs is crucial for enhancing downstream tasks such as object detection and segmentation. While deep learning has significantly advanced SR, achieving high-quality reconstructions with fine-grained details and realistic textures remains challenging, particularly at high upscaling factors. Recent approaches leveraging diffusion models have demonstrated promising results, yet they often struggle to balance perceptual quality with structural fidelity. In this work, we introduce ResQu a novel SR framework that integrates a quaternion wavelet preprocessing framework with latent diffusion models, incorporating a new quaternion wavelet- and time-aware encoder. Unlike prior methods that simply apply wavelet transforms within diffusion models, our approach enhances the conditioning process by exploiting quaternion wavelet embeddings, which are dynamically integrated at different stages of denoising. Furthermore, we also leverage the generative priors of foundation models such as Stable Diffusion. Extensive experiments on domain-specific datasets demonstrate that our method achieves outstanding SR results, outperforming in many cases existing approaches in perceptual quality and standard evaluation metrics. The code will be available after the revision process.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑