arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.10983cs.CV

面向能量的扩散桥:基于基础扩散模型的图像修复

Energy-oriented Diffusion Bridge for Image Restoration with Foundational Diffusion Models

Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);Department of Computer Science, City University of Hong Kong (Dongguan)(香港城市大学(东莞)计算机科学系)

Jinhui Hou, Zhiyu Zhu, Junhui Hou

AI总结:

本文提出E-Bridge框架,通过设计新型桥过程和连续时间一致性目标,提升图像修复性能,实现低能耗轨迹和任务自适应的平衡。

摘要:

扩散桥模型在图像修复中通过显式连接干净与退化图像分布展现出巨大潜力。然而,它们通常依赖复杂且高成本的轨迹,限制了采样效率和最终修复质量。为此,我们提出面向能量的扩散桥(E-Bridge)框架,通过设计新的桥过程,在较短的时间范围内演化,并从熵正则化的点开始反向过程,该点混合退化图像和高斯噪声,从而理论上减少所需轨迹能量。为高效解决此过程,我们借鉴一致性模型,学习单步映射函数,通过连续时间一致性目标优化,从而将轨迹上的任何状态映射到目标图像。值得注意的是,框架中的轨迹长度成为可调任务自适应的调节器,使模型能够根据不同退化任务(如去噪与超分辨率)自适应平衡信息保留与生成能力。大量实验表明,E-Bridge在各种图像修复任务中均取得最佳性能,同时能够以单次或更少的采样步骤实现高质量恢复。项目页面为https://jinnh.github.io/E-Bridge/。

英文摘要:

Diffusion bridge models have shown great promise in image restoration by explicitly connecting clean and degraded image distributions. However, they often rely on complex and high-cost trajectories, which limit both sampling efficiency and final restoration quality. To address this, we propose an Energy-oriented diffusion Bridge (E-Bridge) framework to approximate a set of low-cost manifold geodesic trajectories to boost the performance of the proposed method. We achieve this by designing a novel bridge process that evolves over a shorter time horizon and makes the reverse process start from an entropy-regularized point that mixes the degraded image and Gaussian noise, which theoretically reduces the required trajectory energy. To solve this process efficiently, we draw inspiration from consistency models to learn a single-step mapping function, optimized via a continuous-time consistency objective tailored for our trajectory, so as to analytically map any state on the trajectory to the target image. Notably, the trajectory length in our framework becomes a tunable task-adaptive knob, allowing the model to adaptively balance information preservation against generative power for tasks of varying degradation, such as denoising versus super-resolution. Extensive experiments demonstrate that our E-Bridge achieves state-of-the-art performance across various image restoration tasks while enabling high-quality recovery with a single or fewer sampling steps. Our project page is https://jinnh.github.io/E-Bridge/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑