arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.24136cs.CVeess.IV
收藏

连接恢复与生成流形的单步扩散在现实世界超分辨率中的应用

Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution

National Yang Ming Chiao Tung University, Hsinchu, Taiwan;MediaTek Inc., Taiwan

Shyang-En Weng, Yi-Cheng Liao, Yu-Syuan Xu, Chia-Hung Yuan, Wei-Chen Chiu, Ching-Chun Huang

AI总结:

本文提出IDaS-SR框架,通过Manifold Inversion Noise Estimator和CHARIOT机制,解决单步扩散中恢复与生成流形的匹配问题,提升现实世界超分辨率的性能。

摘要:

预训练扩散模型已革新了现实世界图像超分辨率(Real-ISR),但因迭代采样导致计算瓶颈。最近的单步蒸馏加速了推理,但面临感知-失真权衡的严峻挑战,由于固有的时间步初始化、分布轨迹不匹配和脆弱的随机调制。为此,我们提出了Adaptive Inversion和Degradation-aware Sampling for Real-ISR(IDaS-SR),一个连接确定性恢复和随机生成流形的单步框架。其核心是Manifold Inversion Noise Estimator(MINE),通过预测严重性感知的时间步和倒置噪声,精确地将低质量潜在映射到扩散轨迹上。此外,为缓解脆弱的随机调制,我们提出了CHARIOT,一种连续生成引导机制。通过重新调度轨迹和插值噪声,它使显式导航感知-失真边界而不影响结构先验。大量实验表明,IDaS-SR优于现有最先进方法,能够无缝从严格的结构恢复器过渡到复杂的纹理 hallucinator,在单步推理中实现。

英文摘要:

Pretrained diffusion models have revolutionized real-world image super-resolution (Real-ISR), but their iterative sampling is computationally prohibitive, driving efforts to distill it into a single step. General one-step methods fine-tune the generative prior into a deterministic mapping, restoring efficiency but discarding its stochastic nature. Conversely, recent attempts re-engage generation by shifting the timestep or injecting random noise, adjusting either the position or the state while the other stays fixed. Because only one side is controlled, the two align at isolated preset timesteps but drift apart once steered, leaving generation unstable. To address this, we present one-step diffusion via Inversion and Degradation-aware Sampling for Real-ISR (IDaS-SR), a one-step framework that bridges deterministic restoration and stochastic generation. At its core, Manifold Anchoring grounds the low-quality latent on the pretrained trajectory through two operations jointly estimated by the Manifold Inversion Noise Estimator (MINE): positioning declares where the latent lies and how it deviates from the clean state, while inversion aligns the latent to the declared position. Upon the anchor, CHARIOT reintroduces controlled stochasticity by jointly rescheduling the trajectory and interpolating the noise, enabling a single scalar to smoothly navigate the fidelity-realism trade-off. Extensive experiments demonstrate that IDaS-SR effectively unleashes the generative prior, achieving state-of-the-art performance under explicit control in a single inference step.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑